Jul 07 14:58:40.778028 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 14:58:40.778040 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 14:58:40.778046 ip-10-0-131-27 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 14:58:40.778267 ip-10-0-131-27 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 14:58:51.010326 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 14:58:51.010343 ip-10-0-131-27 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot af30be07dde54926ba6ccb8427cc316c --
Jul 07 15:00:41.142687 ip-10-0-131-27 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.546135    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550569    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550582    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550585    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550589    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550592    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550596    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550599    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.071759 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550602    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550605    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550608    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550610    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550613    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550616    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550619    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550622    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550625    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550627    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550630    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550632    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550636    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550639    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550641    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550644    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550647    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550649    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550653    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.073303 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550655    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550658    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550661    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550663    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550666    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550669    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550672    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550674    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550677    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550679    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550682    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550684    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550687    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550689    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550693    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550696    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550699    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550702    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550704    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550707    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.074115 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550710    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550712    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550715    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550718    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550720    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550723    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550728    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550730    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550733    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550735    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550738    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550741    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550743    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550746    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550748    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550751    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550754    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550757    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550759    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550762    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.075294 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550764    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550769    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550773    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550776    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550779    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550782    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550788    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550792    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550795    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550798    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550801    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550804    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550806    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550809    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550811    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550814    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550817    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550820    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550824    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.076086 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550827    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550830    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550832    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550836    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550838    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550842    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550844    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550847    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550851    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550854    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550856    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550859    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550862    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.550864    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551576    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551583    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551586    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551589    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551592    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551595    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.076806 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551599    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551601    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551604    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551606    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551609    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551612    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551614    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551617    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551619    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551622    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551626    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551629    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551632    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551635    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551638    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551641    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551643    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551646    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551648    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551651    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.077439 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551654    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551656    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551659    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551661    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551664    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551667    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551669    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551672    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551675    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551677    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551681    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551683    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551686    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551688    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551691    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551694    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551697    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551699    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551702    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551704    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.078079 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551707    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551709    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551712    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551714    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551717    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551720    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551723    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551725    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551728    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551732    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551736    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551739    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551742    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551745    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551747    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551750    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551753    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551756    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551759    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.078648 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551762    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551765    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551768    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551772    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551775    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551777    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551780    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551783    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551785    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551789    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551792    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551795    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551798    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551801    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551804    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551806    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551809    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551811    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551814    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551817    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.079190 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551820    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551823    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551825    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551828    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551830    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551833    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551836    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551839    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551842    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551844    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551847    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551849    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551852    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.551854    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552293    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552299    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552303    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552306    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552309    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552311    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.080044 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552314    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552317    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552319    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552322    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552324    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552327    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552329    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552332    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552334    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552337    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552339    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552342    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552348    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552351    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552354    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552356    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552359    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552361    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552365    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.080714 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552367    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552370    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552373    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552378    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552381    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552399    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552402    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552404    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552407    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552410    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552414    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552418    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552420    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552423    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552426    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552429    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552432    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552434    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552437    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.081262 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552440    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552442    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552445    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552448    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552451    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552453    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552456    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552459    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552462    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552465    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552467    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552469    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552472    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552475    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552477    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552479    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552482    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552484    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552487    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.082200 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552491    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552495    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552497    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552500    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552503    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552507    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552509    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552512    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552515    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552517    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552519    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552522    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552525    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552527    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552530    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552533    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552535    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552538    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552540    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552543    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.082785 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552545    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552548    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552550    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552553    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552555    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552558    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552563    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552567    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552569    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552572    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552574    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552577    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552579    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552582    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552584    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.552587    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552661    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552670    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552681    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552688    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552695    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:00:43.083359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552698    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552703    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552707    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552710    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552713    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552717    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552720    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552723    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552726    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552729    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552733    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552735    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552738    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552743    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552746    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552749    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552752    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552757    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552760    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552764    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552767    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552770    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552773    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552776    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:00:43.084041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552779    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552782    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552784    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552789    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552792    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552795    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552797    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552800    2583 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552803    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552808    2583 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552811    2583 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552814    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552817    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552820    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552824    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552829    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552832    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552835    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552838    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552841    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552844    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552847    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552850    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552853    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552856    2583 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:00:43.084875 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552861    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552863    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552866    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552869    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552873    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552876    2583 flags.go:64] FLAG: --help="false"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552878    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552881    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552884    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552887    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552890    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552893    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552896    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552899    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552902    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552905    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552908    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552911    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552914    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552917    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552919    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552922    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552926    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552929    2583 flags.go:64] FLAG: --lock-file=""
Jul 07 15:00:43.086173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552932    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552935    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552938    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552945    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552949    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552953    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552957    2583 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552960    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552967    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552970    2583 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552973    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552977    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552980    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552985    2583 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552988    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552990    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552994    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.552997    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553000    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553003    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553005    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553013    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553016    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553019    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:00:43.087441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553022    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553025    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553031    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553034    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553037    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553040    2583 flags.go:64] FLAG: --port="10250"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553044    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553047    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f995ba7fb88386e"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553051    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553053    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553057    2583 flags.go:64] FLAG: --register-node="true"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553059    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553063    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553066    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553068    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553072    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553075    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553080    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553083    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553086    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553089    2583 flags.go:64] FLAG: --runonce="false"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553092    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553095    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553098    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553101    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:00:43.088292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553105    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553108    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553110    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553114    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553116    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553119    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553122    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553125    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553128    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553131    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553134    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553139    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553142    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553146    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553150    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553153    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553156    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553159    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553162    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553165    2583 flags.go:64] FLAG: --v="2"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553168    2583 flags.go:64] FLAG: --version="false"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553172    2583 flags.go:64] FLAG: --vmodule=""
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553176    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.553180    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553298    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.089265 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553301    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553304    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553307    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553309    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553312    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553315    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553317    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553320    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553322    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553325    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553327    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553330    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553332    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553335    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553338    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553340    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553343    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553345    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553348    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.090094 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553351    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553355    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553357    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553360    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553362    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553365    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553368    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553372    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553375    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553378    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553381    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553399    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553403    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553406    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553409    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553412    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553414    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553417    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553419    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.090958 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553422    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553424    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553427    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553430    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553432    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553435    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553437    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553440    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553442    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553445    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553447    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553450    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553452    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553455    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553458    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553461    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553465    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553468    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553471    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553474    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.091835 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553477    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553480    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553482    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553485    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553488    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553493    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553498    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553502    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553504    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553508    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553510    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553513    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553516    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553518    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553521    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553524    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553526    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553529    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553531    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553534    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.092871 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553536    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553539    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553541    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553544    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553547    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553549    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553553    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553556    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553558    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553560    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553563    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553566    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553568    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553570    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553573    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553575    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553578    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553582    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553585    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.093436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:41.553588    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:41.554160    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.037774    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.037795    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.037819    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.037827    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037896    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037902    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037906    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037910    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037913    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037916    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037920    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037924    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037927    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.093984 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037931    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037935    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037939    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037943    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037950    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037953    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037957    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037960    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037963    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037967    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037970    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037972    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037976    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037979    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037981    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037984    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037989    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037992    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037995    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.037997    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.094426 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038001    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038004    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038007    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038009    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038014    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038018    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038022    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038026    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038030    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038033    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038036    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038039    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038042    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038044    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038048    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038052    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038056    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038060    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038064    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038066    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.095002 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038069    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038072    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038075    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038077    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038080    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038084    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038087    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038091    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038096    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038100    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038105    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038109    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038112    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038115    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038119    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038124    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038126    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038130    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038133    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.095671 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038135    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038138    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038142    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038145    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038148    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038151    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038155    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038158    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038161    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038166    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038171    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038176    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038181    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038186    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038189    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038191    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038194    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038198    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038201    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.096247 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038204    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038207    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038212    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038214    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038217    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038220    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038224    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038227    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038230    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038233    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038236    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038240    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.038247    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038402    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038410    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:43.203572 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038413    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:43.111390 ip-10-0-131-27 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038416    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038419    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038423    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038427    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038430    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038433    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038437    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038440    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038444    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038449    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038453    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038458    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038461    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038464    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038467    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038471    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038473    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038476    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038480    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:43.205364 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038484    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038487    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038492    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038495    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038500    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038504    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038507    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038509    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038512    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038515    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038519    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038521    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038524    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038527    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038531    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038533    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038551    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038555    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038558    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038563    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:43.206132 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038567    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038570    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038573    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038578    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038581    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038583    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038586    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038588    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038591    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038593    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038597    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038601    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038606    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038610    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038613    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038616    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038620    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038622    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038625    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038628    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:43.206833 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038632    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038634    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038637    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038639    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038643    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038646    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038648    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038651    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038655    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038658    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038661    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038666    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038669    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038673    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038675    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038679    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038684    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038687    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038692    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:43.207436 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038694    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038697    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038700    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038704    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038707    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038712    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038716    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038720    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038725    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038730    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038733    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038738    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038741    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038744    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038748    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038752    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038755    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:43.208047 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:43.038757    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.038763    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.038888    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.041279    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.042829    2583 server.go:1019] "Starting client certificate rotation"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.042932    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.042979    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.045252    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.050657    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.077292    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.079285    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.079755    2583 log.go:25] "Validated CRI v1 image API"
Jul 07 15:00:43.208590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.080526    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:00:43.209156 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.083039    2583 fs.go:135] Filesystem UUIDs: map[2ad56611-158f-4533-80fe-bd8890383965:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f3693743-b2a6-4ba1-b09e-35a09cf51822:/dev/nvme0n1p4]
Jul 07 15:00:43.209156 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.083059    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.091382    2583 manager.go:216] Machine: {Timestamp:2026-07-07 15:00:43.090765371 +0000 UTC m=+0.356510337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094654 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25495411f686b2775077b57dc8b3d7 SystemUUID:ec254954-11f6-86b2-7750-77b57dc8b3d7 BootID:af30be07-dde5-4926-ba6c-cb8427cc316c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:2a:e6:d7:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:2a:e6:d7:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:09:e0:4b:83:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.091562    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.091717    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.094861    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.094903    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.095683    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.095694    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.095702    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.095712    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.096900    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100081    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100212    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100244    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100255    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100266    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100277    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:00:43.209502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100274    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cltd2"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100287    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100677    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.100692    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.103200    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.105056    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.105084    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106259    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106273    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106280    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106286    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106295    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106302    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106311    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106316    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106323    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106329    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106338    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.106343    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.107043    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.107054    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.107783    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cltd2"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.110332    2583 server.go:1268] "Started kubelet"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.110529    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.110564    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.110904    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.112053    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.112512    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.112588    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.112598    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.112657    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.116461    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.118115    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.118692    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.119025    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.119310    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.119312    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.119334    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.119420    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.119428    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120206    2583 factory.go:55] Registering systemd factory
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120224    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120414    2583 factory.go:153] Registering CRI-O factory
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120429    2583 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120487    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120530    2583 factory.go:103] Registering Raw factory
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120559    2583 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120751    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:43.210108 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.120947    2583 manager.go:349] Starting recovery of all containers
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.123759    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.130256    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.132611    2583 manager.go:354] Recovery completed
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.136866    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.138727    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.138760    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.138772    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.139234    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.139245    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.139249    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.139261    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140355    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140378    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140387    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140439    2583 policy_none.go:49] "None policy: Start"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140452    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.140463    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.141757    2583 policy_none.go:47] "Start"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176163    2583 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.176365    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176376    2583 server.go:87] "Starting device plugin registration server"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176612    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176622    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176726    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176828    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.176837    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.179377    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.179427    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.276838    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.277359    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.277407    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.277441    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.277484    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.278018    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.278047    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.278061    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.278092    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.279797    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.285225    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.285243    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-27.ec2.internal\": node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.354432 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.316554    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.377832    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"]
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.377918    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.379449    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.379479    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.379494    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381144    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381303    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381332    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381920    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381945    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381955    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381960    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381977    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.381989    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.383168    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.383191    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.383924    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.383954    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.383964    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.411287    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.415635    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.417624    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.420915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.420937    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f590796caafd9ede31a5a0b1060392-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"f5f590796caafd9ede31a5a0b1060392\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.420962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.517726    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.530075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f590796caafd9ede31a5a0b1060392-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"f5f590796caafd9ede31a5a0b1060392\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.533039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522141    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f590796caafd9ede31a5a0b1060392-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"f5f590796caafd9ede31a5a0b1060392\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.533039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522163    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.533039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.522185    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c38fa7c716279930859073b43aea943-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"7c38fa7c716279930859073b43aea943\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.673309 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.618502    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.829250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.713892    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.829250 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.718978    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.829250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.719011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:43.829250 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.819780    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.940602 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:43.920241    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:43.963255 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:43.963233    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:44.020768 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:44.020732    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:44.043039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.043016    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:00:44.043206 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.043185    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:00:44.043269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.043215    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:00:44.043269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.043216    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:00:44.113582 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.113496    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:55:43 +0000 UTC" deadline="2027-12-01 09:13:29.818972456 +0000 UTC"
Jul 07 15:00:44.113582 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.113553    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12282h12m45.705438858s"
Jul 07 15:00:44.121104 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:44.121075    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:44.222088 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:44.222046    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found"
Jul 07 15:00:44.251826 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.251810    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:44.318894 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.318866    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:44.329673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.329647    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:00:44.330495 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.330481    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"
Jul 07 15:00:44.339121 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.339104    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:00:44.438461 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:44.438433    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f590796caafd9ede31a5a0b1060392.slice/crio-88368496cecfab6ca840002d67a2ff299f7363ce30d2d02266f712d3587a31c1 WatchSource:0}: Error finding container 88368496cecfab6ca840002d67a2ff299f7363ce30d2d02266f712d3587a31c1: Status 404 returned error can't find the container with id 88368496cecfab6ca840002d67a2ff299f7363ce30d2d02266f712d3587a31c1
Jul 07 15:00:44.442704 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.442690    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:00:44.563254 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:44.563231    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c38fa7c716279930859073b43aea943.slice/crio-b0994a8373db4d45e9d3b014123be617c8e90344a6193da84f5ddef04458f0f6 WatchSource:0}: Error finding container b0994a8373db4d45e9d3b014123be617c8e90344a6193da84f5ddef04458f0f6: Status 404 returned error can't find the container with id b0994a8373db4d45e9d3b014123be617c8e90344a6193da84f5ddef04458f0f6
Jul 07 15:00:44.953119 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:44.953086    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:45.101977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.101933    2583 apiserver.go:52] "Watching apiserver"
Jul 07 15:00:45.112827 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.112796    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:00:45.114071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.114040    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rrknw","openshift-ovn-kubernetes/ovnkube-node-lxts9","kube-system/global-pull-secret-syncer-r8zc9","kube-system/konnectivity-agent-qm5p6","kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mzmx6","openshift-image-registry/node-ca-2twf9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-2n9cq","openshift-multus/network-metrics-daemon-9v6gc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj","openshift-dns/node-resolver-5pmgg","openshift-multus/multus-tbqkn","openshift-network-diagnostics/network-check-target-qttb9"]
Jul 07 15:00:45.115881 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.115854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.117163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.117074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.118209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.118273    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.118491    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.118813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.119004    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.119023    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.119199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.119153    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j8v28\""
Jul 07 15:00:45.120089 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.120070    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lpxhq\""
Jul 07 15:00:45.120330 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.120313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.120638 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.120603    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:00:45.120863 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.120829    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.121263 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.121231    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.122212 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.122195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:45.122288 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.122261    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:45.122891 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.122451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.123434 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.123415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.124648 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.124629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.126878 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.126857    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:00:45.127027 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127009    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xkf5b\""
Jul 07 15:00:45.127259 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127243    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:00:45.127326 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127299    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.127425 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127406    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.127497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127478    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b4wdc\""
Jul 07 15:00:45.127497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127489    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.127701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127530    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.127701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127613    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:00:45.127701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.127652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.127701 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.127707    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:45.128158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.128139    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:00:45.128440 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.128419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.128661 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.128643    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:00:45.128886 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.128872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:00:45.129112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.129095    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zw4zt\""
Jul 07 15:00:45.129336 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.129323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wgvzp\""
Jul 07 15:00:45.129407 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.129368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.129951 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.129905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b41caeac-251a-42e9-856a-8656f00edfc8-agent-certs\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.130052 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.129966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlj6n\" (UniqueName: \"kubernetes.io/projected/87bbadc7-56f2-46f9-907e-5af352736689-kube-api-access-rlj6n\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.130052 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b41caeac-251a-42e9-856a-8656f00edfc8-konnectivity-ca\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.130158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130041    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:45.130158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-conf\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-device-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.130158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-var-lib-kubelet\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130132    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-tuned\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzjl\" (UniqueName: \"kubernetes.io/projected/19575ced-e073-4f9c-8494-8dee9006b5a9-kube-api-access-nxzjl\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh5fx\" (UniqueName: \"kubernetes.io/projected/e13004d1-b7d6-4202-8282-69a4bd5e10d5-kube-api-access-jh5fx\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-kubelet-config\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.130393 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-host\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87bbadc7-56f2-46f9-907e-5af352736689-serviceca\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-kubernetes\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-run\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-lib-modules\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130565    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-tmp\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87bbadc7-56f2-46f9-907e-5af352736689-host\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-dbus\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.130680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-modprobe-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-sys\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130751    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysconfig\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.131126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.130861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-systemd\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.131707 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.131682    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rtbnm\""
Jul 07 15:00:45.131982 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.131966    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.132359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.132344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:00:45.132694 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.132675    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.132792 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.132750    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsfmm\""
Jul 07 15:00:45.133060 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.132991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:00:45.133060 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.132999    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:00:45.133203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.133077    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qdqnx\""
Jul 07 15:00:45.133203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.133157    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.133503 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.133482    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:00:45.136390 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.136227    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:00:45.152918 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.152891    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:45.158751 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.158687    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7t5vq"
Jul 07 15:00:45.167802 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.167755    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7t5vq"
Jul 07 15:00:45.220546 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.220464    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:00:45.231276 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-slash\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.231412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/574deda0-e040-43d4-a738-a367b326c1eb-hosts-file\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.231412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdl2\" (UniqueName: \"kubernetes.io/projected/574deda0-e040-43d4-a738-a367b326c1eb-kube-api-access-kzdl2\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.231412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-dbus\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.231412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-modprobe-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-script-lib\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-system-cni-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysconfig\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-socket-dir-parent\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-netns\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-kubelet\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.231620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-bin\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-dbus\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-conf\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231652    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-modprobe-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231713    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysconfig\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231713    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-device-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-cni-binary-copy\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s248\" (UniqueName: \"kubernetes.io/projected/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-kube-api-access-5s248\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-var-lib-kubelet\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231851    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-device-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-tuned\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzjl\" (UniqueName: \"kubernetes.io/projected/19575ced-e073-4f9c-8494-8dee9006b5a9-kube-api-access-nxzjl\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231913    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-var-lib-kubelet\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231811    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-conf\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.231942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-cnibin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-k8s-cni-cncf-io\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231964    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.231985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-multus\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-kubelet\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-systemd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-log-socket\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2l79\" (UniqueName: \"kubernetes.io/projected/19582102-62e4-4d46-821e-d05b20aede59-kube-api-access-w2l79\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-kubelet-config\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-host\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232229    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-host\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232247    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232258    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/119c7224-9d6a-44de-af5c-fd139489779f-kubelet-config\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87bbadc7-56f2-46f9-907e-5af352736689-serviceca\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-kubernetes\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-lib-modules\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.232817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-tmp\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-bin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-kubernetes\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232573    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-lib-modules\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232286    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232841    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87bbadc7-56f2-46f9-907e-5af352736689-serviceca\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-conf-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-ovn\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-env-overrides\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.232979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-host-slash\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-sys\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-multus-daemon-config\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-multus-certs\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cnibin\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233202    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.233460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-systemd\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-systemd-units\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-netd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b41caeac-251a-42e9-856a-8656f00edfc8-agent-certs\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlj6n\" (UniqueName: \"kubernetes.io/projected/87bbadc7-56f2-46f9-907e-5af352736689-kube-api-access-rlj6n\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-etc-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-config\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-iptables-alerter-script\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b41caeac-251a-42e9-856a-8656f00edfc8-konnectivity-ca\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-hostroot\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-var-lib-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.234284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-netns\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-node-log\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqvq\" (UniqueName: \"kubernetes.io/projected/7813f584-e7bd-4016-9aaf-2316a4498bbd-kube-api-access-swqvq\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh5fx\" (UniqueName: \"kubernetes.io/projected/e13004d1-b7d6-4202-8282-69a4bd5e10d5-kube-api-access-jh5fx\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-system-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzjgt\" (UniqueName: \"kubernetes.io/projected/5482255c-1d65-49de-bc8b-743774bb6e76-kube-api-access-jzjgt\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkmw\" (UniqueName: \"kubernetes.io/projected/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-kube-api-access-rwkmw\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/574deda0-e040-43d4-a738-a367b326c1eb-tmp-dir\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-os-release\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.233945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-os-release\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-etc-kubernetes\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.235032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-run\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87bbadc7-56f2-46f9-907e-5af352736689-host\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234287    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87bbadc7-56f2-46f9-907e-5af352736689-host\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-sys\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.234503    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-systemd\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.235807 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.235768    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:45.236077 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.235828    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-run\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.236077 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.235863    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-sysctl-d\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.236077 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.235953    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:45.735914513 +0000 UTC m=+3.001659479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:45.237103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.237081    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b41caeac-251a-42e9-856a-8656f00edfc8-konnectivity-ca\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.237204 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.237173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19575ced-e073-4f9c-8494-8dee9006b5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.237884 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.237847    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-tmp\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.238172 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.238151    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:45.238247 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.238180    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:45.238247 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.238194    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:45.238350 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.238252    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:45.738232288 +0000 UTC m=+3.003977261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:45.239407 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.239385    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b41caeac-251a-42e9-856a-8656f00edfc8-agent-certs\") pod \"konnectivity-agent-qm5p6\" (UID: \"b41caeac-251a-42e9-856a-8656f00edfc8\") " pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.239514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.239495    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e13004d1-b7d6-4202-8282-69a4bd5e10d5-etc-tuned\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.240990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.240968    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzjl\" (UniqueName: \"kubernetes.io/projected/19575ced-e073-4f9c-8494-8dee9006b5a9-kube-api-access-nxzjl\") pod \"aws-ebs-csi-driver-node-vhnkj\" (UID: \"19575ced-e073-4f9c-8494-8dee9006b5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.245571 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.245495    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh5fx\" (UniqueName: \"kubernetes.io/projected/e13004d1-b7d6-4202-8282-69a4bd5e10d5-kube-api-access-jh5fx\") pod \"tuned-mzmx6\" (UID: \"e13004d1-b7d6-4202-8282-69a4bd5e10d5\") " pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.245717 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.245697    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlj6n\" (UniqueName: \"kubernetes.io/projected/87bbadc7-56f2-46f9-907e-5af352736689-kube-api-access-rlj6n\") pod \"node-ca-2twf9\" (UID: \"87bbadc7-56f2-46f9-907e-5af352736689\") " pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.283103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.283054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"7c38fa7c716279930859073b43aea943","Type":"ContainerStarted","Data":"b0994a8373db4d45e9d3b014123be617c8e90344a6193da84f5ddef04458f0f6"}
Jul 07 15:00:45.284417 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.284385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"f5f590796caafd9ede31a5a0b1060392","Type":"ContainerStarted","Data":"88368496cecfab6ca840002d67a2ff299f7363ce30d2d02266f712d3587a31c1"}
Jul 07 15:00:45.334579 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2l79\" (UniqueName: \"kubernetes.io/projected/19582102-62e4-4d46-821e-d05b20aede59-kube-api-access-w2l79\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-bin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-conf-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-ovn\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-env-overrides\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334709    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-ovn\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334718    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-bin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.334753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334719    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-conf-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-host-slash\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-multus-daemon-config\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-host-slash\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-multus-certs\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.334988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cnibin\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-systemd-units\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335076    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cnibin\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.335113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-netd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335124    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-netd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.335206    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335229    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-env-overrides\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-etc-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.335262    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:45.835244305 +0000 UTC m=+3.100989272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-etc-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-multus-certs\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335289    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-systemd-units\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-config\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335317    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-iptables-alerter-script\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-hostroot\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.335650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-var-lib-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335440    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-multus-daemon-config\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-netns\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-node-log\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqvq\" (UniqueName: \"kubernetes.io/projected/7813f584-e7bd-4016-9aaf-2316a4498bbd-kube-api-access-swqvq\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-system-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzjgt\" (UniqueName: \"kubernetes.io/projected/5482255c-1d65-49de-bc8b-743774bb6e76-kube-api-access-jzjgt\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335601    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkmw\" (UniqueName: \"kubernetes.io/projected/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-kube-api-access-rwkmw\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/574deda0-e040-43d4-a738-a367b326c1eb-tmp-dir\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-os-release\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335683    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-netns\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335747    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-system-cni-dir\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-hostroot\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.336443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335784    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-var-lib-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335882    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-iptables-alerter-script\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335979    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-node-log\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.335686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-os-release\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336125    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-etc-kubernetes\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336159    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336204    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-config\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-slash\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/574deda0-e040-43d4-a738-a367b326c1eb-hosts-file\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336254    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336307    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-openvswitch\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336257    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-etc-kubernetes\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdl2\" (UniqueName: \"kubernetes.io/projected/574deda0-e040-43d4-a738-a367b326c1eb-kube-api-access-kzdl2\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336309    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-os-release\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.337306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-script-lib\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-system-cni-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/574deda0-e040-43d4-a738-a367b326c1eb-hosts-file\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-slash\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-socket-dir-parent\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336413    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/574deda0-e040-43d4-a738-a367b326c1eb-tmp-dir\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-netns\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336448    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-kubelet\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336485    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-multus-socket-dir-parent\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336503    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-os-release\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336500    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-system-cni-dir\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336511    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-netns\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-bin\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336559    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-kubelet\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336567    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-cni-bin\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-cni-binary-copy\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s248\" (UniqueName: \"kubernetes.io/projected/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-kube-api-access-5s248\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.338097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-cnibin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336692    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-cnibin\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-k8s-cni-cncf-io\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-multus\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-kubelet\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-systemd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336799    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-run-k8s-cni-cncf-io\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336838    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5482255c-1d65-49de-bc8b-743774bb6e76-host-var-lib-cni-multus\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336847    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-host-kubelet\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-log-socket\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336890    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovnkube-script-lib\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336929    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-log-socket\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.336971    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7813f584-e7bd-4016-9aaf-2316a4498bbd-run-systemd\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.337085    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5482255c-1d65-49de-bc8b-743774bb6e76-cni-binary-copy\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.339039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.337939    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7813f584-e7bd-4016-9aaf-2316a4498bbd-ovn-node-metrics-cert\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.344109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.344048    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2l79\" (UniqueName: \"kubernetes.io/projected/19582102-62e4-4d46-821e-d05b20aede59-kube-api-access-w2l79\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.346478 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.346449    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzjgt\" (UniqueName: \"kubernetes.io/projected/5482255c-1d65-49de-bc8b-743774bb6e76-kube-api-access-jzjgt\") pod \"multus-tbqkn\" (UID: \"5482255c-1d65-49de-bc8b-743774bb6e76\") " pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.348408 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.347855    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdl2\" (UniqueName: \"kubernetes.io/projected/574deda0-e040-43d4-a738-a367b326c1eb-kube-api-access-kzdl2\") pod \"node-resolver-5pmgg\" (UID: \"574deda0-e040-43d4-a738-a367b326c1eb\") " pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.348916 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.348889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqvq\" (UniqueName: \"kubernetes.io/projected/7813f584-e7bd-4016-9aaf-2316a4498bbd-kube-api-access-swqvq\") pod \"ovnkube-node-lxts9\" (UID: \"7813f584-e7bd-4016-9aaf-2316a4498bbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.349336 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.349312    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s248\" (UniqueName: \"kubernetes.io/projected/d7a16cba-ac3d-47f8-a96f-e1e8b535fc98-kube-api-access-5s248\") pod \"multus-additional-cni-plugins-2n9cq\" (UID: \"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98\") " pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.349432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.349411    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkmw\" (UniqueName: \"kubernetes.io/projected/1d527b96-9c1b-486b-94c9-a3b38d27ddb3-kube-api-access-rwkmw\") pod \"iptables-alerter-rrknw\" (UID: \"1d527b96-9c1b-486b-94c9-a3b38d27ddb3\") " pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.432089 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.432056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2twf9"
Jul 07 15:00:45.440474 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.440451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj"
Jul 07 15:00:45.450823 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.450796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:00:45.458709 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.458609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzmx6"
Jul 07 15:00:45.465003 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.464975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2n9cq"
Jul 07 15:00:45.474086 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.474021    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbqkn"
Jul 07 15:00:45.482254 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.482222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:00:45.490168 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.490143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrknw"
Jul 07 15:00:45.497874 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.497840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pmgg"
Jul 07 15:00:45.739312 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.739221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:45.739312 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.739269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739381    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739393    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739411    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739423    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739450    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.739433848 +0000 UTC m=+4.005178803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:45.739526 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.739466    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.739459598 +0000 UTC m=+4.005204551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:45.840442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.840407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:45.840623 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.840575    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:45.840680 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:45.840640    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.84062417 +0000 UTC m=+4.106369123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:45.927976 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:45.927939    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:46.171581 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:46.171483    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:45 +0000 UTC" deadline="2028-01-02 22:53:30.656157098 +0000 UTC"
Jul 07 15:00:46.171581 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:46.171509    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13063h52m44.484650581s"
Jul 07 15:00:46.398382 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.398354    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13004d1_b7d6_4202_8282_69a4bd5e10d5.slice/crio-5fa7d568777debe999349e22790af3ead1ce90c22d58dbb616baf93879d16344 WatchSource:0}: Error finding container 5fa7d568777debe999349e22790af3ead1ce90c22d58dbb616baf93879d16344: Status 404 returned error can't find the container with id 5fa7d568777debe999349e22790af3ead1ce90c22d58dbb616baf93879d16344
Jul 07 15:00:46.400606 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.400556    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bbadc7_56f2_46f9_907e_5af352736689.slice/crio-a9f4ab79118ad5d53951a554dee0b65fb548b8fe8ff7e6da0cc2105429350577 WatchSource:0}: Error finding container a9f4ab79118ad5d53951a554dee0b65fb548b8fe8ff7e6da0cc2105429350577: Status 404 returned error can't find the container with id a9f4ab79118ad5d53951a554dee0b65fb548b8fe8ff7e6da0cc2105429350577
Jul 07 15:00:46.404845 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.404819    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5482255c_1d65_49de_bc8b_743774bb6e76.slice/crio-309a84826554a5b3f6ff8d981c645abfe9e491ab51f80b332fb1991710182410 WatchSource:0}: Error finding container 309a84826554a5b3f6ff8d981c645abfe9e491ab51f80b332fb1991710182410: Status 404 returned error can't find the container with id 309a84826554a5b3f6ff8d981c645abfe9e491ab51f80b332fb1991710182410
Jul 07 15:00:46.406321 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.406299    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574deda0_e040_43d4_a738_a367b326c1eb.slice/crio-aa962798422656765e9ececf7c78048c86f3d8f7932de47cf0007736f6e3de2c WatchSource:0}: Error finding container aa962798422656765e9ececf7c78048c86f3d8f7932de47cf0007736f6e3de2c: Status 404 returned error can't find the container with id aa962798422656765e9ececf7c78048c86f3d8f7932de47cf0007736f6e3de2c
Jul 07 15:00:46.407610 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.406995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19575ced_e073_4f9c_8494_8dee9006b5a9.slice/crio-1b6b69a2bece3d6fa264490b12253c7cf6e2df52da126817a8b2237991a6ab96 WatchSource:0}: Error finding container 1b6b69a2bece3d6fa264490b12253c7cf6e2df52da126817a8b2237991a6ab96: Status 404 returned error can't find the container with id 1b6b69a2bece3d6fa264490b12253c7cf6e2df52da126817a8b2237991a6ab96
Jul 07 15:00:46.410663 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.408938    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a16cba_ac3d_47f8_a96f_e1e8b535fc98.slice/crio-aaf9355625158bb12f89f6bc00ac5bf4c544af5cf4790b5aeafe2775d445c4e4 WatchSource:0}: Error finding container aaf9355625158bb12f89f6bc00ac5bf4c544af5cf4790b5aeafe2775d445c4e4: Status 404 returned error can't find the container with id aaf9355625158bb12f89f6bc00ac5bf4c544af5cf4790b5aeafe2775d445c4e4
Jul 07 15:00:46.410663 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.409701    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d527b96_9c1b_486b_94c9_a3b38d27ddb3.slice/crio-7c42c0207af9873a4545006c4cf382d57ba376c24bf6de7c56c961d4a056f158 WatchSource:0}: Error finding container 7c42c0207af9873a4545006c4cf382d57ba376c24bf6de7c56c961d4a056f158: Status 404 returned error can't find the container with id 7c42c0207af9873a4545006c4cf382d57ba376c24bf6de7c56c961d4a056f158
Jul 07 15:00:46.412253 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.411655    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7813f584_e7bd_4016_9aaf_2316a4498bbd.slice/crio-09baedf5da3ba5f261a6f4516cd9fb231fcdde5d0e1e755a1871248b793864c5 WatchSource:0}: Error finding container 09baedf5da3ba5f261a6f4516cd9fb231fcdde5d0e1e755a1871248b793864c5: Status 404 returned error can't find the container with id 09baedf5da3ba5f261a6f4516cd9fb231fcdde5d0e1e755a1871248b793864c5
Jul 07 15:00:46.415794 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:00:46.415669    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41caeac_251a_42e9_856a_8656f00edfc8.slice/crio-96ab8821c335dced04ae7630a9de93897ada9ef24f7130b005a670f961c41042 WatchSource:0}: Error finding container 96ab8821c335dced04ae7630a9de93897ada9ef24f7130b005a670f961c41042: Status 404 returned error can't find the container with id 96ab8821c335dced04ae7630a9de93897ada9ef24f7130b005a670f961c41042
Jul 07 15:00:46.747603 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:46.747495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:46.747603 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:46.747573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:46.747812 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747642    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:46.747812 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747710    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:48.747691282 +0000 UTC m=+6.013436238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:46.747812 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747730    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:46.747812 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747755    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:46.747812 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747771    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:46.747989 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.747821    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:48.747804846 +0000 UTC m=+6.013549818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:46.848455 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:46.848412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:46.848674 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.848654    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:46.848754 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:46.848730    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:48.848709071 +0000 UTC m=+6.114454026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:47.172056 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.171937    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:45 +0000 UTC" deadline="2028-04-15 06:50:45.791413918 +0000 UTC"
Jul 07 15:00:47.172056 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.172002    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15543h49m58.619415999s"
Jul 07 15:00:47.283055 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.283022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:47.283232 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:47.283171    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:47.283605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.283583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:47.283717 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:47.283696    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:47.283778 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.283763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:47.283846 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:47.283830    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:47.295205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.295166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2twf9" event={"ID":"87bbadc7-56f2-46f9-907e-5af352736689","Type":"ContainerStarted","Data":"a9f4ab79118ad5d53951a554dee0b65fb548b8fe8ff7e6da0cc2105429350577"}
Jul 07 15:00:47.311767 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.311722    2583 generic.go:356] "Generic (PLEG): container finished" podID="7c38fa7c716279930859073b43aea943" containerID="81ff5e48d99372476e82564e9cd6c146de3728fe00b809ae2e3d847895c0725c" exitCode=0
Jul 07 15:00:47.312106 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.312004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"7c38fa7c716279930859073b43aea943","Type":"ContainerDied","Data":"81ff5e48d99372476e82564e9cd6c146de3728fe00b809ae2e3d847895c0725c"}
Jul 07 15:00:47.319331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.318638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrknw" event={"ID":"1d527b96-9c1b-486b-94c9-a3b38d27ddb3","Type":"ContainerStarted","Data":"7c42c0207af9873a4545006c4cf382d57ba376c24bf6de7c56c961d4a056f158"}
Jul 07 15:00:47.341636 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.341500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj" event={"ID":"19575ced-e073-4f9c-8494-8dee9006b5a9","Type":"ContainerStarted","Data":"1b6b69a2bece3d6fa264490b12253c7cf6e2df52da126817a8b2237991a6ab96"}
Jul 07 15:00:47.345300 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.345183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pmgg" event={"ID":"574deda0-e040-43d4-a738-a367b326c1eb","Type":"ContainerStarted","Data":"aa962798422656765e9ececf7c78048c86f3d8f7932de47cf0007736f6e3de2c"}
Jul 07 15:00:47.347473 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.347393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzmx6" event={"ID":"e13004d1-b7d6-4202-8282-69a4bd5e10d5","Type":"ContainerStarted","Data":"5fa7d568777debe999349e22790af3ead1ce90c22d58dbb616baf93879d16344"}
Jul 07 15:00:47.362620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.361852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"f5f590796caafd9ede31a5a0b1060392","Type":"ContainerStarted","Data":"f0c75707339996e45b31e751721798b275e39a7931a33ef7e50e41748b5fae63"}
Jul 07 15:00:47.378510 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.378407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm5p6" event={"ID":"b41caeac-251a-42e9-856a-8656f00edfc8","Type":"ContainerStarted","Data":"96ab8821c335dced04ae7630a9de93897ada9ef24f7130b005a670f961c41042"}
Jul 07 15:00:47.379783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.379192    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" podStartSLOduration=3.379171616 podStartE2EDuration="3.379171616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:00:47.378869759 +0000 UTC m=+4.644614744" watchObservedRunningTime="2026-07-07 15:00:47.379171616 +0000 UTC m=+4.644916614"
Jul 07 15:00:47.406170 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.406055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"09baedf5da3ba5f261a6f4516cd9fb231fcdde5d0e1e755a1871248b793864c5"}
Jul 07 15:00:47.419430 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.419320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerStarted","Data":"aaf9355625158bb12f89f6bc00ac5bf4c544af5cf4790b5aeafe2775d445c4e4"}
Jul 07 15:00:47.434291 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:47.434136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbqkn" event={"ID":"5482255c-1d65-49de-bc8b-743774bb6e76","Type":"ContainerStarted","Data":"309a84826554a5b3f6ff8d981c645abfe9e491ab51f80b332fb1991710182410"}
Jul 07 15:00:48.456667 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:48.456629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"7c38fa7c716279930859073b43aea943","Type":"ContainerStarted","Data":"3e9172aceac7ba61316fe781f9aba46699e92f99be75f4ae84a7b16719f7c4ae"}
Jul 07 15:00:48.765744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:48.765656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:48.765744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:48.765722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:48.765969 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.765875    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:48.765969 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.765896    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:48.765969 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.765909    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:48.765969 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.765969    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:52.765949422 +0000 UTC m=+10.031694379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:48.766424 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.766396    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:48.766576 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.766459    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:52.766443131 +0000 UTC m=+10.032188089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:48.867756 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:48.867033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:48.867756 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.867269    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:48.867756 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:48.867331    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:52.867314156 +0000 UTC m=+10.133059114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:49.280690 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:49.280658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:49.280886 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:49.280789    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:49.281181 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:49.281161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:49.281286 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:49.281256    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:49.283215 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:49.283195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:49.283350 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:49.283302    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:51.278844 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:51.278764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:51.279263 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:51.278911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:51.279362 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:51.279337    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:51.279445 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:51.279425    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:51.279552 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:51.279522    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:51.279634 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:51.279615    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:52.802005 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:52.801965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:52.802069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802140    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802152    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802161    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802176    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802232    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.802213108 +0000 UTC m=+18.067958080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:52.802484 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.802253    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.802242972 +0000 UTC m=+18.067987926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:52.903472 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:52.903437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:52.903656 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.903616    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:52.903742 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:52.903694    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.903672761 +0000 UTC m=+18.169417715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:53.279312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:53.279411    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:53.279730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:53.279820    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:53.279857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:53.279983 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:53.279917    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:55.278644 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:55.277933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:55.278644 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:55.278070    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:55.278644 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:55.278487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:55.278644 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:55.278601    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:55.279269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:55.278675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:55.279269 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:55.278769    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:57.277847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:57.277812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:57.277847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:57.277835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:57.277847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:57.277812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:57.278418 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:57.277961    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:57.278418 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:57.278042    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:57.278418 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:57.278168    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:00:59.278111 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:59.278051    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:00:59.278657 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:59.278057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:00:59.278657 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:00:59.278198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:00:59.278657 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:59.278192    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:00:59.278657 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:59.278291    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:00:59.278657 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:00:59.278374    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:00.864899 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:00.864865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:00.864899 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:00.864913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865047    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865075    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865097    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865110    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865135    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.865110371 +0000 UTC m=+34.130855329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:00.865450 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.865162    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.865144111 +0000 UTC m=+34.130889113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:00.965989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:00.965951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:00.966182 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.966087    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:00.966182 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:00.966165    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.966144764 +0000 UTC m=+34.231889733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:01.278507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:01.278423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:01.278507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:01.278456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:01.278731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:01.278423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:01.278731 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:01.278593    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:01.278839 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:01.278731    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:01.278839 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:01.278813    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:03.279022 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:03.278984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:03.279497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:03.279097    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:03.279497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:03.279136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:03.279497 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:03.279146    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:03.279497 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:03.279227    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:03.279497 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:03.279324    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:05.277925 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.277769    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:05.278715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.277766    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:05.278715 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:05.278013    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:05.278715 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:05.278070    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:05.278715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.277770    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:05.278715 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:05.278165    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:05.492776 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.492517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pmgg" event={"ID":"574deda0-e040-43d4-a738-a367b326c1eb","Type":"ContainerStarted","Data":"c24a29a17fee57387025da36e4be18f900a0c788917a428a0c7ca3d7d0d91ab2"}
Jul 07 15:01:05.494326 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.494303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzmx6" event={"ID":"e13004d1-b7d6-4202-8282-69a4bd5e10d5","Type":"ContainerStarted","Data":"c6120cfeda066a3e24508ee03b736f75ebc476b4de7ea0cb00cfbdc4c0008cc7"}
Jul 07 15:01:05.495672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.495649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm5p6" event={"ID":"b41caeac-251a-42e9-856a-8656f00edfc8","Type":"ContainerStarted","Data":"c17544cab7f2e5f81cc05412b1af4223bfbfd21dba8bd3c86fbccd503b5d3c1f"}
Jul 07 15:01:05.498076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.498052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"a1aefe50e5437713cf723f56e1320b75aa2e2bd74b367db71d3462ae9cbbe427"}
Jul 07 15:01:05.498172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.498105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"5c17d08f90148f2d5d8f129b8fa174d01d6cb5090bccdf1a27b3f9cc9b069add"}
Jul 07 15:01:05.498172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.498145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"4c2fa95dcd115e7ff34edc56902c575ce2f48a83d806d3a783b57547eaf63db8"}
Jul 07 15:01:05.498259 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.498176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"5d791631ecfc9eabdfb6b1bf7469d47a18c1cbe5e198ee95ca7372071b16c44b"}
Jul 07 15:01:05.499569 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.499519    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="401b415fb3047a4a168791fb2828e8a59e5b2807ec3fe09f465537ae7dba2341" exitCode=0
Jul 07 15:01:05.499665 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.499560    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"401b415fb3047a4a168791fb2828e8a59e5b2807ec3fe09f465537ae7dba2341"}
Jul 07 15:01:05.501086 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.501062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbqkn" event={"ID":"5482255c-1d65-49de-bc8b-743774bb6e76","Type":"ContainerStarted","Data":"a00a64ff1371fe2d93428ccc77350b5257b1881a24f696b949872de3a479e4f5"}
Jul 07 15:01:05.502511 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.502486    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2twf9" event={"ID":"87bbadc7-56f2-46f9-907e-5af352736689","Type":"ContainerStarted","Data":"8471a19e3e97ad428da6df639a91500d18ee2ab97d9d553c39dfe601abdd554b"}
Jul 07 15:01:05.503912 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.503895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj" event={"ID":"19575ced-e073-4f9c-8494-8dee9006b5a9","Type":"ContainerStarted","Data":"e8839803becdf4e16f80cd9ea6e2ec00ea6fbd9477f8005ffed2927b13990813"}
Jul 07 15:01:05.511436 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.511397    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" podStartSLOduration=21.51138485 podStartE2EDuration="21.51138485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:00:48.47417627 +0000 UTC m=+5.739921246" watchObservedRunningTime="2026-07-07 15:01:05.51138485 +0000 UTC m=+22.777129828"
Jul 07 15:01:05.511642 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.511623    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5pmgg" podStartSLOduration=4.074122805 podStartE2EDuration="22.511617053s" totalImagesPullingTime="18.437494248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:05.511195175 +0000 UTC m=+22.776940151" watchObservedRunningTime="2026-07-07 15:01:05.511617053 +0000 UTC m=+22.777362028"
Jul 07 15:01:05.526063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.525973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2twf9" podStartSLOduration=4.08563154 podStartE2EDuration="22.525952759s" totalImagesPullingTime="18.440321219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:05.525526371 +0000 UTC m=+22.791271378" watchObservedRunningTime="2026-07-07 15:01:05.525952759 +0000 UTC m=+22.791697737"
Jul 07 15:01:05.539786 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.539741    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qm5p6" podStartSLOduration=12.206872726 podStartE2EDuration="22.539722956s" totalImagesPullingTime="10.33285023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:05.539566001 +0000 UTC m=+22.805310968" watchObservedRunningTime="2026-07-07 15:01:05.539722956 +0000 UTC m=+22.805467931"
Jul 07 15:01:05.574966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.574908    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tbqkn" podStartSLOduration=4.08880098 podStartE2EDuration="22.574885323s" totalImagesPullingTime="18.486084343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:05.574674591 +0000 UTC m=+22.840419568" watchObservedRunningTime="2026-07-07 15:01:05.574885323 +0000 UTC m=+22.840630300"
Jul 07 15:01:05.575502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.575462    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mzmx6" podStartSLOduration=4.126859507 podStartE2EDuration="22.575450593s" totalImagesPullingTime="18.448591086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:05.556723828 +0000 UTC m=+22.822468804" watchObservedRunningTime="2026-07-07 15:01:05.575450593 +0000 UTC m=+22.841195568"
Jul 07 15:01:05.931068 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.931032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:01:05.931707 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:05.931687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:01:06.346292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.346269    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:01:06.508329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.508249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrknw" event={"ID":"1d527b96-9c1b-486b-94c9-a3b38d27ddb3","Type":"ContainerStarted","Data":"ac5c47f7a737e2b1b9e59546fac34d86039699f997b9bf207603c074d994da58"}
Jul 07 15:01:06.510297 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.510265    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj" event={"ID":"19575ced-e073-4f9c-8494-8dee9006b5a9","Type":"ContainerStarted","Data":"c72521e304bb2d24d5584ce839ecd720f736e1f8009d577eebb1b98ea402582d"}
Jul 07 15:01:06.513711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.513679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"cfefc01164bd4de48c1d1be5422a415a83971c8cdcfcf289b11c873d44e9b804"}
Jul 07 15:01:06.513835 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.513759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"b7611e0e76c8ad46f1236fdd38b67a0a7029834c8b09f4f78c843fdef86a4ba0"}
Jul 07 15:01:06.527660 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:06.527598    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrknw" podStartSLOduration=5.096544218 podStartE2EDuration="23.527576962s" totalImagesPullingTime="18.431032744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:06.52428471 +0000 UTC m=+23.790029686" watchObservedRunningTime="2026-07-07 15:01:06.527576962 +0000 UTC m=+23.793321938"
Jul 07 15:01:07.192479 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.192347    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:01:06.346286009Z","UUID":"78612977-124e-48e6-ad52-431089d7dc75","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:01:07.194143 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.194122    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:01:07.194275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.194165    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.278463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:07.278604    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.278783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.278803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:07.278911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:07.279322 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:07.279009    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:07.515746 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:07.515721    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:08.522081 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:08.521829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"57f23727d2768e4335ad4cd25458ae9b514c400a44578422c349e0a50d9adc95"}
Jul 07 15:01:08.524054 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:08.524030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj" event={"ID":"19575ced-e073-4f9c-8494-8dee9006b5a9","Type":"ContainerStarted","Data":"a9e19b43202901f5f4f8e3613496947e134f49e8589800b4277689847b1a1d25"}
Jul 07 15:01:08.542610 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:08.542561    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhnkj" podStartSLOduration=4.855745083 podStartE2EDuration="25.542530992s" totalImagesPullingTime="20.686785909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:08.54223144 +0000 UTC m=+25.807976418" watchObservedRunningTime="2026-07-07 15:01:08.542530992 +0000 UTC m=+25.808275968"
Jul 07 15:01:09.278246 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:09.278203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:09.278459 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:09.278252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:09.278459 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:09.278216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:09.278459 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:09.278346    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:09.278645 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:09.278452    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:09.278645 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:09.278578    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:10.532135 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.531824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" event={"ID":"7813f584-e7bd-4016-9aaf-2316a4498bbd","Type":"ContainerStarted","Data":"db1fbf76ca0ab8b333c8a3b601b46220f15e51a393ab1bf0028ee456e9ea8f79"}
Jul 07 15:01:10.532972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.532148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:10.533703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.533680    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="9c4a61dbb978179c692d84379ae5f152a2fe137ae35458df8c4df6dc13d4f846" exitCode=0
Jul 07 15:01:10.533703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.533713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"9c4a61dbb978179c692d84379ae5f152a2fe137ae35458df8c4df6dc13d4f846"}
Jul 07 15:01:10.548356 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.548332    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:10.558881 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:10.558840    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" podStartSLOduration=9.058088599 podStartE2EDuration="27.55882648s" totalImagesPullingTime="18.500737881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:10.558635746 +0000 UTC m=+27.824380721" watchObservedRunningTime="2026-07-07 15:01:10.55882648 +0000 UTC m=+27.824571455"
Jul 07 15:01:11.280246 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.280208    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:11.280458 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.280352    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:11.280793 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.280772    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:11.280894 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.280874    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:11.280951 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.280932    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:11.282656 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.282624    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:11.536486 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.536414    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:11.536911 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.536879    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:11.551631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.551603    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:11.949728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.949520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8zc9"]
Jul 07 15:01:11.949922 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.949803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:11.949922 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.949894    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:11.952103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.952076    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qttb9"]
Jul 07 15:01:11.952229 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.952191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:11.952399 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.952343    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:11.952755 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.952736    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9v6gc"]
Jul 07 15:01:11.952859 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:11.952845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:11.952971 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:11.952952    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:12.540646 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:12.540616    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="897cd955096b0c2af0acf81bf5cca67a838e302ad473e693bf4d85ac8f32fc03" exitCode=0
Jul 07 15:01:12.541092 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:12.540714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"897cd955096b0c2af0acf81bf5cca67a838e302ad473e693bf4d85ac8f32fc03"}
Jul 07 15:01:12.541092 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:12.540755    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:13.283031 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:13.282995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:13.283208 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:13.283111    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:13.283208 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:13.283150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:13.283319 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:13.283278    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:13.542734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:13.542667    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:14.033888 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.033855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:14.049307 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.049238    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" podUID="7813f584-e7bd-4016-9aaf-2316a4498bbd" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 07 15:01:14.057727 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.057694    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" podUID="7813f584-e7bd-4016-9aaf-2316a4498bbd" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 07 15:01:14.277997 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.277959    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:14.278162 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:14.278068    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:14.546843 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.546812    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="4ed507e48346593927d7c60be60d947f2bfa1eae02a0785e608ddb1c3809bf15" exitCode=0
Jul 07 15:01:14.547529 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.546878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"4ed507e48346593927d7c60be60d947f2bfa1eae02a0785e608ddb1c3809bf15"}
Jul 07 15:01:14.557076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.557047    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9" podUID="7813f584-e7bd-4016-9aaf-2316a4498bbd" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 07 15:01:14.623949 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.623923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:01:14.624111 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.624078    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:14.624650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:14.624624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qm5p6"
Jul 07 15:01:15.281939 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:15.281915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:15.281939 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:15.281937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:15.282182 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:15.282007    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:15.282182 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:15.282152    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:16.251053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.251015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:16.277953 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.277922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:16.278130 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.278050    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:16.342584 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.342529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:16.888231 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.888194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:16.888430 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.888278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:16.888430 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888348    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:01:16.888430 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888369    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:01:16.888430 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888376    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:16.888670 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888438    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret podName:119c7224-9d6a-44de-af5c-fd139489779f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.888419829 +0000 UTC m=+66.154164794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret") pod "global-pull-secret-syncer-r8zc9" (UID: "119c7224-9d6a-44de-af5c-fd139489779f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:16.888670 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888379    2583 projected.go:196] Error preparing data for projected volume kube-api-access-4gt45 for pod openshift-network-diagnostics/network-check-target-qttb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:16.888670 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.888498    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45 podName:f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.888485598 +0000 UTC m=+66.154230551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gt45" (UniqueName: "kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45") pod "network-check-target-qttb9" (UID: "f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:16.989302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:16.989270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:16.989493 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.989420    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:16.989493 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:16.989483    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.989466529 +0000 UTC m=+66.255211484 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:17.278186 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:17.278150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:17.278663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:17.278169    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:17.278663 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:17.278273    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qttb9" podUID="f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3"
Jul 07 15:01:17.278663 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:17.278380    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zc9" podUID="119c7224-9d6a-44de-af5c-fd139489779f"
Jul 07 15:01:18.278390 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.278352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:18.278814 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:18.278505    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:01:18.490663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.490634    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeReady"
Jul 07 15:01:18.490834 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.490789    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:01:18.535114 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.535042    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mgddn"]
Jul 07 15:01:18.562892 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.562863    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pvnf6"]
Jul 07 15:01:18.563051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.562999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.566455 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.566279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:01:18.566621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.566464    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bp52v\""
Jul 07 15:01:18.566621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.566420    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:01:18.583138 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.583112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mgddn"]
Jul 07 15:01:18.583284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.583152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvnf6"]
Jul 07 15:01:18.583284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.583214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.587403 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.587373    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:01:18.587532 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.587443    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8pj6\""
Jul 07 15:01:18.588057 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.588040    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:01:18.588163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.588081    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:01:18.702171 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-config-volume\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.702353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ea881c-9d0a-46a8-baa1-ad30858314d9-cert\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.702353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.702353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702292    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjjc2\" (UniqueName: \"kubernetes.io/projected/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-kube-api-access-kjjc2\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.702507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djncw\" (UniqueName: \"kubernetes.io/projected/18ea881c-9d0a-46a8-baa1-ad30858314d9-kube-api-access-djncw\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.702507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.702494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-tmp-dir\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.803580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djncw\" (UniqueName: \"kubernetes.io/projected/18ea881c-9d0a-46a8-baa1-ad30858314d9-kube-api-access-djncw\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.803580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-tmp-dir\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.803580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-config-volume\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.803864 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ea881c-9d0a-46a8-baa1-ad30858314d9-cert\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.803864 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.803864 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjjc2\" (UniqueName: \"kubernetes.io/projected/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-kube-api-access-kjjc2\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.803864 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:18.803811    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:18.804044 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:18.803913    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:19.303896744 +0000 UTC m=+36.569641698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:18.804044 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.803955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-tmp-dir\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.804315 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.804290    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-config-volume\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.808707 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.808688    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ea881c-9d0a-46a8-baa1-ad30858314d9-cert\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.814025 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.813996    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjjc2\" (UniqueName: \"kubernetes.io/projected/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-kube-api-access-kjjc2\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:18.814229 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.814208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djncw\" (UniqueName: \"kubernetes.io/projected/18ea881c-9d0a-46a8-baa1-ad30858314d9-kube-api-access-djncw\") pod \"ingress-canary-pvnf6\" (UID: \"18ea881c-9d0a-46a8-baa1-ad30858314d9\") " pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:18.893256 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:18.893224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvnf6"
Jul 07 15:01:19.115552 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.115504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvnf6"]
Jul 07 15:01:19.170450 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:01:19.170418    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ea881c_9d0a_46a8_baa1_ad30858314d9.slice/crio-b284f5e1af80c54f9acf3aff547c85cae04a98613e2361af9cd6a17a26529075 WatchSource:0}: Error finding container b284f5e1af80c54f9acf3aff547c85cae04a98613e2361af9cd6a17a26529075: Status 404 returned error can't find the container with id b284f5e1af80c54f9acf3aff547c85cae04a98613e2361af9cd6a17a26529075
Jul 07 15:01:19.278297 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.278268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:19.278446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.278427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:19.281783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.281760    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:01:19.282389 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.282374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2msz5\""
Jul 07 15:01:19.282718 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.282699    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:01:19.282806 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.282728    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:01:19.308702 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.308623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:19.308776 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:19.308758    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:19.308846 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:19.308834    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:20.308814836 +0000 UTC m=+37.574559867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:19.562210 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.562180    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="a59293e836babb6db2f2f3ce28562827e412e96728d1e27020a11f92fecac392" exitCode=0
Jul 07 15:01:19.562381 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.562250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"a59293e836babb6db2f2f3ce28562827e412e96728d1e27020a11f92fecac392"}
Jul 07 15:01:19.563441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:19.563419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvnf6" event={"ID":"18ea881c-9d0a-46a8-baa1-ad30858314d9","Type":"ContainerStarted","Data":"b284f5e1af80c54f9acf3aff547c85cae04a98613e2361af9cd6a17a26529075"}
Jul 07 15:01:20.277940 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.277908    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:20.280857 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.280813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:01:20.281246 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.280832    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbwr6\""
Jul 07 15:01:20.316569 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.316524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:20.316726 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:20.316705    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:20.316801 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:20.316779    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:22.316758476 +0000 UTC m=+39.582503432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:20.451370 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.451331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:20.551575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.551328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:20.570066 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.570031    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a16cba-ac3d-47f8-a96f-e1e8b535fc98" containerID="1d27b5e9ceea53d88a7a7622128aac1a66cc9f0d1e5f12ece68bfe1eeb49ddf5" exitCode=0
Jul 07 15:01:20.570219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:20.570079    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerDied","Data":"1d27b5e9ceea53d88a7a7622128aac1a66cc9f0d1e5f12ece68bfe1eeb49ddf5"}
Jul 07 15:01:21.578054 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.578013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" event={"ID":"d7a16cba-ac3d-47f8-a96f-e1e8b535fc98","Type":"ContainerStarted","Data":"90f08d9b147077b676625bb3da1376e8943f3973218e6965feb477d28fcfff05"}
Jul 07 15:01:21.579456 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.579433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvnf6" event={"ID":"18ea881c-9d0a-46a8-baa1-ad30858314d9","Type":"ContainerStarted","Data":"f5122530b2065ea5bbb7ec7c924da6f7e3915eedf2def0b3f63493d2001f50cb"}
Jul 07 15:01:21.606197 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.606132    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2n9cq" podStartSLOduration=8.634256598 podStartE2EDuration="38.606110885s" totalImagesPullingTime="29.971854287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:21.603848736 +0000 UTC m=+38.869593710" watchObservedRunningTime="2026-07-07 15:01:21.606110885 +0000 UTC m=+38.871855861"
Jul 07 15:01:21.619641 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.619568    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pvnf6" podStartSLOduration=1.302642646 podStartE2EDuration="3.619526176s" totalImagesPullingTime="2.31688353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:21.618358287 +0000 UTC m=+38.884103264" watchObservedRunningTime="2026-07-07 15:01:21.619526176 +0000 UTC m=+38.885271153"
Jul 07 15:01:21.704636 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.704600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:21.815599 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.815498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:21.913789 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:21.913749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:22.310308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:22.310271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:22.335605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:22.335568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:22.335799 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:22.335746    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:22.335869 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:22.335843    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:26.335820648 +0000 UTC m=+43.601565615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:22.412301 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:22.412265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:22.900247 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:22.900209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:23.206389 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:23.206333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:25.200230 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:25.200189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:25.301353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:25.301316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:26.366626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:26.366583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:26.367001 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:26.366713    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:26.367001 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:26.366767    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:34.366753277 +0000 UTC m=+51.632498230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:31.460682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:31.460648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:31.560986 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:31.560941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:34.428028 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:34.427991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:34.428423 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:34.428099    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:34.428423 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:34.428159    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:50.428144881 +0000 UTC m=+67.693889833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:36.180386 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:36.180350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:36.250563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:36.250509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:36.314295 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:36.314256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:40.221248 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:40.221211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:40.304969 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:40.304936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:44.557092 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:44.557064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxts9"
Jul 07 15:01:44.712232 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:44.712190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:44.790952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:44.790913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:48.930784 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.930734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:48.931491 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.930833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:48.936664 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.933967    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:01:48.936664 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.934161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:01:48.943604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.943577    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:01:48.944401 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.944362    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/119c7224-9d6a-44de-af5c-fd139489779f-original-pull-secret\") pod \"global-pull-secret-syncer-r8zc9\" (UID: \"119c7224-9d6a-44de-af5c-fd139489779f\") " pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:48.953753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.953731    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gt45\" (UniqueName: \"kubernetes.io/projected/f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3-kube-api-access-4gt45\") pod \"network-check-target-qttb9\" (UID: \"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3\") " pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:48.988699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.988661    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zc9"
Jul 07 15:01:48.995382 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:48.995361    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2msz5\""
Jul 07 15:01:49.002756 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.002732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:49.031573 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.031526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:01:49.034455 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.034425    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:01:49.043290 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:49.043221    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:01:49.043415 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:49.043313    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:53.043286985 +0000 UTC m=+130.309031959 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : secret "metrics-daemon-secret" not found
Jul 07 15:01:49.137506 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.137472    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8zc9"]
Jul 07 15:01:49.141734 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:01:49.141710    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119c7224_9d6a_44de_af5c_fd139489779f.slice/crio-c204c36e1927d8b99705d931fabbf4a50b3e3d814fffa9f596b44035eab0397b WatchSource:0}: Error finding container c204c36e1927d8b99705d931fabbf4a50b3e3d814fffa9f596b44035eab0397b: Status 404 returned error can't find the container with id c204c36e1927d8b99705d931fabbf4a50b3e3d814fffa9f596b44035eab0397b
Jul 07 15:01:49.149617 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.149595    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qttb9"]
Jul 07 15:01:49.152105 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:01:49.152078    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f3ebb0_b64f_4a2d_adff_a4f3e27310a3.slice/crio-61c5afdb4a725a860ff3929475a8d41d5f683cc78b813d1e77d79137b8b151ac WatchSource:0}: Error finding container 61c5afdb4a725a860ff3929475a8d41d5f683cc78b813d1e77d79137b8b151ac: Status 404 returned error can't find the container with id 61c5afdb4a725a860ff3929475a8d41d5f683cc78b813d1e77d79137b8b151ac
Jul 07 15:01:49.641501 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.641459    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qttb9" event={"ID":"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3","Type":"ContainerStarted","Data":"61c5afdb4a725a860ff3929475a8d41d5f683cc78b813d1e77d79137b8b151ac"}
Jul 07 15:01:49.642585 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:49.642555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8zc9" event={"ID":"119c7224-9d6a-44de-af5c-fd139489779f","Type":"ContainerStarted","Data":"c204c36e1927d8b99705d931fabbf4a50b3e3d814fffa9f596b44035eab0397b"}
Jul 07 15:01:50.440214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:50.440183    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:01:50.440742 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:50.440325    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:50.440742 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:01:50.440395    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:22.440376579 +0000 UTC m=+99.706121556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:54.121577 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.121523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:54.178625 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.178593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:54.245045 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.245016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:54.657173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.657138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qttb9" event={"ID":"f7f3ebb0-b64f-4a2d-adff-a4f3e27310a3","Type":"ContainerStarted","Data":"130463b7e1500b24e4c9a654f98916e0aae0f55cc8dc3db1fb912bf6e7015a95"}
Jul 07 15:01:54.657362 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.657275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:01:54.658680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.658653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8zc9" event={"ID":"119c7224-9d6a-44de-af5c-fd139489779f","Type":"ContainerStarted","Data":"3d0b11d6e20527e55be65f3218e4330c4f707d3992c5c1e96b3de84be0876272"}
Jul 07 15:01:54.675083 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.675036    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qttb9" podStartSLOduration=66.399945786 podStartE2EDuration="1m11.675023636s" totalImagesPullingTime="5.27507785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:54.673395455 +0000 UTC m=+71.939140430" watchObservedRunningTime="2026-07-07 15:01:54.675023636 +0000 UTC m=+71.940768610"
Jul 07 15:01:54.687839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:54.687796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r8zc9" podStartSLOduration=66.412977645 podStartE2EDuration="1m11.687780928s" totalImagesPullingTime="5.274803283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:54.687281873 +0000 UTC m=+71.953026862" watchObservedRunningTime="2026-07-07 15:01:54.687780928 +0000 UTC m=+71.953525903"
Jul 07 15:01:56.350448 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:56.350413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:01:56.582780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:01:56.582750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:02:18.455291 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:02:18.455140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:02:18.663360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:02:18.663314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:02:22.457576 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:02:22.457505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:02:22.458008 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:02:22.457657    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:02:22.458008 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:02:22.457730    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:03:26.457713714 +0000 UTC m=+163.723458667 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:02:25.663475 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:02:25.663441    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qttb9"
Jul 07 15:02:53.057703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:02:53.057646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:02:53.058189 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:02:53.057812    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:02:53.058189 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:02:53.057897    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:55.057880423 +0000 UTC m=+252.323625376 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : secret "metrics-daemon-secret" not found
Jul 07 15:03:10.055492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:03:10.055456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:03:21.574377 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:03:21.574331    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mgddn" podUID="dd0a9694-7f69-467c-aeda-a4eef34a5fb5"
Jul 07 15:03:21.859606 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:03:21.859507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:03:23.287789 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:03:23.287754    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:03:26.482345 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:03:26.482314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:03:26.482814 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:03:26.482413    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:03:26.482814 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:03:26.482468    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls podName:dd0a9694-7f69-467c-aeda-a4eef34a5fb5 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:28.4824528 +0000 UTC m=+285.748197772 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls") pod "dns-default-mgddn" (UID: "dd0a9694-7f69-467c-aeda-a4eef34a5fb5") : secret "dns-default-metrics-tls" not found
Jul 07 15:03:37.278755 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:03:37.278665    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:04:16.351300 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:16.351263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:42.977970 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.977932    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"]
Jul 07 15:04:42.979920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.979897    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:42.983000 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.982979    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:04:42.983966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.983937    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:42.985153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.984695    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 15:04:42.985153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.984966    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-khl7t\""
Jul 07 15:04:42.986481 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.986419    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:42.995115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.995095    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:04:42.995763 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.995742    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:04:42.995892 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.995862    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:04:42.996490 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.996475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwmxm\""
Jul 07 15:04:42.998771 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.998756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 15:04:42.999039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:42.999026    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.003730 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.003711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"]
Jul 07 15:04:43.032993 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.032968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:04:43.033278 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.033259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:04:43.075169 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.075139    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"]
Jul 07 15:04:43.077034 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.077019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"
Jul 07 15:04:43.079140 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.079112    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"]
Jul 07 15:04:43.079927 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.079904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5s78t\""
Jul 07 15:04:43.080023 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.079945    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:43.080788 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.080774    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.080912 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.080895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.083360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.083340    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:43.083630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.083610    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 15:04:43.083737 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.083615    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g659p\""
Jul 07 15:04:43.083953 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.083936    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.088521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvdg\" (UniqueName: \"kubernetes.io/projected/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-kube-api-access-mfvdg\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.088626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.088874 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088874 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088874 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088828    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbggw\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.088874 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.088855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-config\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.093478 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.093457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"]
Jul 07 15:04:43.097596 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.097574    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"]
Jul 07 15:04:43.189960 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.189923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.189960 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.189958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.189981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbggw\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-config\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ln9\" (UniqueName: \"kubernetes.io/projected/c466caee-714c-47b2-a5a2-880fe2729cda-kube-api-access-l9ln9\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.190219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvdg\" (UniqueName: \"kubernetes.io/projected/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-kube-api-access-mfvdg\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.190686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77nhv\" (UniqueName: \"kubernetes.io/projected/480ef445-fa62-424c-a934-94fb3345835b-kube-api-access-77nhv\") pod \"volume-data-source-validator-5d456fdbcd-jqb4c\" (UID: \"480ef445-fa62-424c-a934-94fb3345835b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"
Jul 07 15:04:43.190686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190677    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.190850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.190744    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.192843 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.192826    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 15:04:43.192934 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.192884    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:04:43.193122 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.193099    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:04:43.193186 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.193143    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 15:04:43.193439 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.193426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:04:43.198418 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.198399    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:04:43.199614 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.199597    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbggw\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.199687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.199604    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.200003 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.199989    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:43.200144 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.200126    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:04:43.200178 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.200150    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77478d4499-cvd7j: secret "image-registry-tls" not found
Jul 07 15:04:43.200223 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.200207    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls podName:ede4bfcb-fe77-43d5-9fa3-565b5c6dba24 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:43.700186122 +0000 UTC m=+240.965931095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls") pod "image-registry-77478d4499-cvd7j" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24") : secret "image-registry-tls" not found
Jul 07 15:04:43.200969 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.200944    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-config\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.201526 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.201501    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.202309 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.202287    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.202435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.202418    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.202626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.202609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.210284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.210264    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.220495 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.220471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvdg\" (UniqueName: \"kubernetes.io/projected/25d905e1-27ca-4063-8cc9-5cb80c4fd12b-kube-api-access-mfvdg\") pod \"service-ca-operator-5d46d9ffd4-hkjjd\" (UID: \"25d905e1-27ca-4063-8cc9-5cb80c4fd12b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.249253 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.249179    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:43.291520 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.291491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77nhv\" (UniqueName: \"kubernetes.io/projected/480ef445-fa62-424c-a934-94fb3345835b-kube-api-access-77nhv\") pod \"volume-data-source-validator-5d456fdbcd-jqb4c\" (UID: \"480ef445-fa62-424c-a934-94fb3345835b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"
Jul 07 15:04:43.291698 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.291550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.291698 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.291588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ln9\" (UniqueName: \"kubernetes.io/projected/c466caee-714c-47b2-a5a2-880fe2729cda-kube-api-access-l9ln9\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.294651 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.294633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 15:04:43.295972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.295955    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-khl7t\""
Jul 07 15:04:43.300811 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.300793    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:43.300892 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.300795    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 15:04:43.301838 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.301822    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:04:43.301889 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.301878    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls podName:c466caee-714c-47b2-a5a2-880fe2729cda nodeName:}" failed. No retries permitted until 2026-07-07 15:04:43.801861979 +0000 UTC m=+241.067606931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lrvbk" (UID: "c466caee-714c-47b2-a5a2-880fe2729cda") : secret "samples-operator-tls" not found
Jul 07 15:04:43.304069 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.304052    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"
Jul 07 15:04:43.311330 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.311311    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.311424 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.311395    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:43.322252 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.322227    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ln9\" (UniqueName: \"kubernetes.io/projected/c466caee-714c-47b2-a5a2-880fe2729cda-kube-api-access-l9ln9\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.322367 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.322265    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77nhv\" (UniqueName: \"kubernetes.io/projected/480ef445-fa62-424c-a934-94fb3345835b-kube-api-access-77nhv\") pod \"volume-data-source-validator-5d456fdbcd-jqb4c\" (UID: \"480ef445-fa62-424c-a934-94fb3345835b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"
Jul 07 15:04:43.389795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.389771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5s78t\""
Jul 07 15:04:43.397606 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.397583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"
Jul 07 15:04:43.423361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.423329    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd"]
Jul 07 15:04:43.427096 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:04:43.427071    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d905e1_27ca_4063_8cc9_5cb80c4fd12b.slice/crio-a03b1ffaae91f0e1a1616ea2b8cc6a6896bbf81a408e6ba85900a2d236725069 WatchSource:0}: Error finding container a03b1ffaae91f0e1a1616ea2b8cc6a6896bbf81a408e6ba85900a2d236725069: Status 404 returned error can't find the container with id a03b1ffaae91f0e1a1616ea2b8cc6a6896bbf81a408e6ba85900a2d236725069
Jul 07 15:04:43.523289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.523216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c"]
Jul 07 15:04:43.526406 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:04:43.526383    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480ef445_fa62_424c_a934_94fb3345835b.slice/crio-26c150b44e5c9ae25987b13dfb9602182762d81e29f66a5229b04bc021d9f5e6 WatchSource:0}: Error finding container 26c150b44e5c9ae25987b13dfb9602182762d81e29f66a5229b04bc021d9f5e6: Status 404 returned error can't find the container with id 26c150b44e5c9ae25987b13dfb9602182762d81e29f66a5229b04bc021d9f5e6
Jul 07 15:04:43.796009 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.795899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:43.796163 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.796058    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:04:43.796163 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.796078    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77478d4499-cvd7j: secret "image-registry-tls" not found
Jul 07 15:04:43.796163 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.796130    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls podName:ede4bfcb-fe77-43d5-9fa3-565b5c6dba24 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:44.796114518 +0000 UTC m=+242.061859470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls") pod "image-registry-77478d4499-cvd7j" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24") : secret "image-registry-tls" not found
Jul 07 15:04:43.896983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:43.896948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:43.897090 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.897059    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:04:43.897159 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:43.897104    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls podName:c466caee-714c-47b2-a5a2-880fe2729cda nodeName:}" failed. No retries permitted until 2026-07-07 15:04:44.897091246 +0000 UTC m=+242.162836199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lrvbk" (UID: "c466caee-714c-47b2-a5a2-880fe2729cda") : secret "samples-operator-tls" not found
Jul 07 15:04:44.051267 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:44.051184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c" event={"ID":"480ef445-fa62-424c-a934-94fb3345835b","Type":"ContainerStarted","Data":"26c150b44e5c9ae25987b13dfb9602182762d81e29f66a5229b04bc021d9f5e6"}
Jul 07 15:04:44.052129 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:44.052107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd" event={"ID":"25d905e1-27ca-4063-8cc9-5cb80c4fd12b","Type":"ContainerStarted","Data":"a03b1ffaae91f0e1a1616ea2b8cc6a6896bbf81a408e6ba85900a2d236725069"}
Jul 07 15:04:44.804790 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:44.804743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:44.804978 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:44.804900    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:04:44.804978 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:44.804924    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77478d4499-cvd7j: secret "image-registry-tls" not found
Jul 07 15:04:44.805092 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:44.804995    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls podName:ede4bfcb-fe77-43d5-9fa3-565b5c6dba24 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:46.80497259 +0000 UTC m=+244.070717547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls") pod "image-registry-77478d4499-cvd7j" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24") : secret "image-registry-tls" not found
Jul 07 15:04:44.905312 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:44.905266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:44.905495 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:44.905425    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:04:44.905495 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:44.905489    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls podName:c466caee-714c-47b2-a5a2-880fe2729cda nodeName:}" failed. No retries permitted until 2026-07-07 15:04:46.905474431 +0000 UTC m=+244.171219385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lrvbk" (UID: "c466caee-714c-47b2-a5a2-880fe2729cda") : secret "samples-operator-tls" not found
Jul 07 15:04:45.425087 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:45.425029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:46.059281 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.059237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd" event={"ID":"25d905e1-27ca-4063-8cc9-5cb80c4fd12b","Type":"ContainerStarted","Data":"a83da66f318a4882b2445dbee6fb23928527c32ecfd3823d5d8ae870afb7ac39"}
Jul 07 15:04:46.060682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.060655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c" event={"ID":"480ef445-fa62-424c-a934-94fb3345835b","Type":"ContainerStarted","Data":"c675245f2ce3f76b2dd5ea7e551343ff08ee22b23bff8d3cc46e85edd4e924b1"}
Jul 07 15:04:46.076490 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.076403    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd" podStartSLOduration=1.690340415 podStartE2EDuration="4.076388769s" totalImagesPullingTime="2.386048354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:46.076054572 +0000 UTC m=+243.341799548" watchObservedRunningTime="2026-07-07 15:04:46.076388769 +0000 UTC m=+243.342133745"
Jul 07 15:04:46.090707 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.090649    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-jqb4c" podStartSLOduration=1.389165301 podStartE2EDuration="3.090635345s" totalImagesPullingTime="1.701470044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:46.090398328 +0000 UTC m=+243.356143305" watchObservedRunningTime="2026-07-07 15:04:46.090635345 +0000 UTC m=+243.356380321"
Jul 07 15:04:46.172176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.172139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:46.228528 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.228489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:46.822520 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.822472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:46.822927 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:46.822633    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:04:46.822927 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:46.822651    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77478d4499-cvd7j: secret "image-registry-tls" not found
Jul 07 15:04:46.822927 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:46.822704    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls podName:ede4bfcb-fe77-43d5-9fa3-565b5c6dba24 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:50.822688955 +0000 UTC m=+248.088433928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls") pod "image-registry-77478d4499-cvd7j" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24") : secret "image-registry-tls" not found
Jul 07 15:04:46.923721 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:46.923674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:46.923817 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:46.923800    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:04:46.923859 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:46.923850    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls podName:c466caee-714c-47b2-a5a2-880fe2729cda nodeName:}" failed. No retries permitted until 2026-07-07 15:04:50.923836957 +0000 UTC m=+248.189581910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lrvbk" (UID: "c466caee-714c-47b2-a5a2-880fe2729cda") : secret "samples-operator-tls" not found
Jul 07 15:04:47.979233 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:47.979191    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.048843 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.048807    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"]
Jul 07 15:04:48.050833 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.050817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"
Jul 07 15:04:48.053399 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.053379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s5nzf\""
Jul 07 15:04:48.053497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.053403    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 15:04:48.054594 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.054578    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 15:04:48.062426 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.062403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"]
Jul 07 15:04:48.111784 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.111753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.119697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.119673    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tkpwg"]
Jul 07 15:04:48.121888 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.121873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.124802 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.124778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:04:48.124900 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.124781    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:04:48.124900 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.124811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gkfhx\""
Jul 07 15:04:48.125071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.125054    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:04:48.125153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.125054    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:04:48.132650 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.132630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tkpwg"]
Jul 07 15:04:48.132883 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.132866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdc7m\" (UniqueName: \"kubernetes.io/projected/76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615-kube-api-access-fdc7m\") pod \"migrator-d57d58cc9-m582f\" (UID: \"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"
Jul 07 15:04:48.185311 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.185280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.233702 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.233702 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfnp\" (UniqueName: \"kubernetes.io/projected/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-api-access-9gfnp\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.233885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdc7m\" (UniqueName: \"kubernetes.io/projected/76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615-kube-api-access-fdc7m\") pod \"migrator-d57d58cc9-m582f\" (UID: \"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"
Jul 07 15:04:48.233885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac12beb0-8932-4ea9-b0e8-243a71893956-crio-socket\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.233885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac12beb0-8932-4ea9-b0e8-243a71893956-data-volume\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.234032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.233960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.241954 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.241925    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdc7m\" (UniqueName: \"kubernetes.io/projected/76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615-kube-api-access-fdc7m\") pod \"migrator-d57d58cc9-m582f\" (UID: \"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"
Jul 07 15:04:48.335257 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac12beb0-8932-4ea9-b0e8-243a71893956-data-volume\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfnp\" (UniqueName: \"kubernetes.io/projected/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-api-access-9gfnp\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac12beb0-8932-4ea9-b0e8-243a71893956-crio-socket\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.335449    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.335474    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335532    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac12beb0-8932-4ea9-b0e8-243a71893956-crio-socket\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.335558    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:48.835519873 +0000 UTC m=+246.101264829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.335610    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:48.835592066 +0000 UTC m=+246.101337037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.335653 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.335614    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac12beb0-8932-4ea9-b0e8-243a71893956-data-volume\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.344691 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.344655    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfnp\" (UniqueName: \"kubernetes.io/projected/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-api-access-9gfnp\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.359078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.359054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"
Jul 07 15:04:48.406361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.406318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.479011 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.478980    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f"]
Jul 07 15:04:48.482120 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.482089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.482283 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:04:48.482101    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a6c4b8_c1b9_428c_a8e6_ac07e7ba5615.slice/crio-7201438d4ef014ce8428193b9533cba5adf06e0962a66a58888d8d42c35d94e0 WatchSource:0}: Error finding container 7201438d4ef014ce8428193b9533cba5adf06e0962a66a58888d8d42c35d94e0: Status 404 returned error can't find the container with id 7201438d4ef014ce8428193b9533cba5adf06e0962a66a58888d8d42c35d94e0
Jul 07 15:04:48.674320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.674286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.777380 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.777284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:48.839578 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.839524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.839751 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:48.839585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:48.839751 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.839668    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.839751 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.839683    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.839751 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.839733    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:49.83971438 +0000 UTC m=+247.105459332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.839751 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:48.839751    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:49.839742527 +0000 UTC m=+247.105487481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:49.070276 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:49.070194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f" event={"ID":"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615","Type":"ContainerStarted","Data":"7201438d4ef014ce8428193b9533cba5adf06e0962a66a58888d8d42c35d94e0"}
Jul 07 15:04:49.846671 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:49.846633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:49.846671 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:49.846673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:49.846871 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:49.846744    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:49.846871 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:49.846782    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:49.846871 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:49.846795    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:51.84678245 +0000 UTC m=+249.112527403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:49.846871 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:49.846842    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:51.84682887 +0000 UTC m=+249.112573823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:50.270668 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.270645    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r7z8h"]
Jul 07 15:04:50.272454 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.272436    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.275063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.275045    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 15:04:50.275180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.275076    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 15:04:50.276177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.276158    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 15:04:50.276278 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.276187    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t7d5f\""
Jul 07 15:04:50.276278 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.276210    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 15:04:50.282120 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.282099    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r7z8h"]
Jul 07 15:04:50.351729 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.351691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-cabundle\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.351921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.351734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mv58\" (UniqueName: \"kubernetes.io/projected/530ae3e4-d4c8-46bc-8619-f428c7fb976e-kube-api-access-4mv58\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.351921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.351880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-key\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.362426 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.362396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:50.452239 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.452189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-cabundle\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.452239 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.452240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mv58\" (UniqueName: \"kubernetes.io/projected/530ae3e4-d4c8-46bc-8619-f428c7fb976e-kube-api-access-4mv58\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.452458 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.452296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-key\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.452989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.452968    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-cabundle\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.454703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.454682    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/530ae3e4-d4c8-46bc-8619-f428c7fb976e-signing-key\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.461214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.461189    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mv58\" (UniqueName: \"kubernetes.io/projected/530ae3e4-d4c8-46bc-8619-f428c7fb976e-kube-api-access-4mv58\") pod \"service-ca-758f599c5-r7z8h\" (UID: \"530ae3e4-d4c8-46bc-8619-f428c7fb976e\") " pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.463243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.463212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:50.582792 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.582755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r7z8h"
Jul 07 15:04:50.704033 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.703848    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pmgg_574deda0-e040-43d4-a738-a367b326c1eb/dns-node-resolver/0.log"
Jul 07 15:04:50.704033 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.703876    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r7z8h"]
Jul 07 15:04:50.706222 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:04:50.706198    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530ae3e4_d4c8_46bc_8619_f428c7fb976e.slice/crio-50521707743abe4a20abca31686927f497889af59cacfe8b5f204496fa4b0c62 WatchSource:0}: Error finding container 50521707743abe4a20abca31686927f497889af59cacfe8b5f204496fa4b0c62: Status 404 returned error can't find the container with id 50521707743abe4a20abca31686927f497889af59cacfe8b5f204496fa4b0c62
Jul 07 15:04:50.855244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.855207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:50.855410 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:50.855321    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:04:50.855410 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:50.855332    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77478d4499-cvd7j: secret "image-registry-tls" not found
Jul 07 15:04:50.855410 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:50.855382    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls podName:ede4bfcb-fe77-43d5-9fa3-565b5c6dba24 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:58.855369238 +0000 UTC m=+256.121114191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls") pod "image-registry-77478d4499-cvd7j" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24") : secret "image-registry-tls" not found
Jul 07 15:04:50.955796 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:50.955708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:50.955950 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:50.955820    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:04:50.955950 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:50.955870    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls podName:c466caee-714c-47b2-a5a2-880fe2729cda nodeName:}" failed. No retries permitted until 2026-07-07 15:04:58.955857185 +0000 UTC m=+256.221602137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lrvbk" (UID: "c466caee-714c-47b2-a5a2-880fe2729cda") : secret "samples-operator-tls" not found
Jul 07 15:04:51.078311 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.078272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r7z8h" event={"ID":"530ae3e4-d4c8-46bc-8619-f428c7fb976e","Type":"ContainerStarted","Data":"430110306c33be970508104cad8f70fccd7a2fd3995bbb4b191ef5fbc4587bb6"}
Jul 07 15:04:51.078517 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.078371    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r7z8h" event={"ID":"530ae3e4-d4c8-46bc-8619-f428c7fb976e","Type":"ContainerStarted","Data":"50521707743abe4a20abca31686927f497889af59cacfe8b5f204496fa4b0c62"}
Jul 07 15:04:51.080016 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.079992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f" event={"ID":"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615","Type":"ContainerStarted","Data":"a1c84403beabedbcc6cb3bc0f777d54bf5ae22b15017c3931727489fe62dca4d"}
Jul 07 15:04:51.080166 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.080031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f" event={"ID":"76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615","Type":"ContainerStarted","Data":"6b04a3544d0afb2c1970cce3f5ef87001855505e19cf92dc02b3b5cd5be0e404"}
Jul 07 15:04:51.096343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.096295    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-r7z8h" podStartSLOduration=1.096280614 podStartE2EDuration="1.096280614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:51.095150075 +0000 UTC m=+248.360895049" watchObservedRunningTime="2026-07-07 15:04:51.096280614 +0000 UTC m=+248.362025567"
Jul 07 15:04:51.115063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.115013    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-m582f" podStartSLOduration=1.44279862 podStartE2EDuration="3.115000366s" totalImagesPullingTime="1.672201746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:51.114121836 +0000 UTC m=+248.379866811" watchObservedRunningTime="2026-07-07 15:04:51.115000366 +0000 UTC m=+248.380745386"
Jul 07 15:04:51.232427 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.232336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:51.701691 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.701665    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2twf9_87bbadc7-56f2-46f9-907e-5af352736689/node-ca/0.log"
Jul 07 15:04:51.863380 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.863336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:51.863562 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:51.863445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:51.863562 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:51.863475    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:51.863562 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:51.863561    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:55.863524129 +0000 UTC m=+253.129269089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:51.863703 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:51.863579    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:51.863703 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:51.863615    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:55.863604717 +0000 UTC m=+253.129349669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:52.251074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.251041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:52.365499 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.365463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:52.525787 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.525646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:52.648323 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.648287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:52.749186 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.749153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:52.902336 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:52.902235    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvnf6_18ea881c-9d0a-46a8-baa1-ad30858314d9/serve-healthcheck-canary/0.log"
Jul 07 15:04:53.017774 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:53.017742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:53.080475 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:53.080444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:53.102140 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:53.102111    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-m582f_76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615/migrator/0.log"
Jul 07 15:04:53.300760 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:53.300733    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-m582f_76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615/graceful-termination/0.log"
Jul 07 15:04:53.957939 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:53.957903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:54.350418 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:54.350322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:54.408792 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:54.408756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:54.595163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:54.595124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:54.850060 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:54.850023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:54.956118 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:54.956080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:55.091957 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:55.091919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:04:55.092392 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.092037    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:04:55.092392 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.092128    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs podName:19582102-62e4-4d46-821e-d05b20aede59 nodeName:}" failed. No retries permitted until 2026-07-07 15:06:57.09210302 +0000 UTC m=+374.357847972 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs") pod "network-metrics-daemon-9v6gc" (UID: "19582102-62e4-4d46-821e-d05b20aede59") : secret "metrics-daemon-secret" not found
Jul 07 15:04:55.898057 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:55.898026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:55.898255 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:55.898102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:04:55.898255 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.898144    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:55.898255 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.898190    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:55.898255 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.898207    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:03.898192865 +0000 UTC m=+261.163937818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:55.898255 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:04:55.898238    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls podName:ac12beb0-8932-4ea9-b0e8-243a71893956 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:03.898227324 +0000 UTC m=+261.163972278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tkpwg" (UID: "ac12beb0-8932-4ea9-b0e8-243a71893956") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:55.990838 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:55.990803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.156103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.156027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.228075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.228035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.357128 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.357085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.550071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.550034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.749050 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.749020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:56.959109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:56.959078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.180917 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.180882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.240283 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.240251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.350553 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.350510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.556269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.556163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.818996 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.818906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:58.924692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.924662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:58.927032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:58.927004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"image-registry-77478d4499-cvd7j\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") " pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:59.026099 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.026059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:59.028358 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.028328    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c466caee-714c-47b2-a5a2-880fe2729cda-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lrvbk\" (UID: \"c466caee-714c-47b2-a5a2-880fe2729cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:59.155881 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.155795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:59.200463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.200432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwmxm\""
Jul 07 15:04:59.208956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.208935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:04:59.212476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.212438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:59.295476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.295420    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g659p\""
Jul 07 15:04:59.302985 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.302960    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"
Jul 07 15:04:59.329400 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.329348    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:04:59.350839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.350812    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:04:59.353852 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:04:59.353824    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede4bfcb_fe77_43d5_9fa3_565b5c6dba24.slice/crio-b545f346d2940a9457c9ce48b0fb81b343bf9ef9d91a84344e03e688e757e77a WatchSource:0}: Error finding container b545f346d2940a9457c9ce48b0fb81b343bf9ef9d91a84344e03e688e757e77a: Status 404 returned error can't find the container with id b545f346d2940a9457c9ce48b0fb81b343bf9ef9d91a84344e03e688e757e77a
Jul 07 15:04:59.437525 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.437497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk"]
Jul 07 15:04:59.754591 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:04:59.754528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:00.109982 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.109889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" event={"ID":"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24","Type":"ContainerStarted","Data":"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"}
Jul 07 15:05:00.109982 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.109948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" event={"ID":"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24","Type":"ContainerStarted","Data":"b545f346d2940a9457c9ce48b0fb81b343bf9ef9d91a84344e03e688e757e77a"}
Jul 07 15:05:00.110179 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.110007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:05:00.111496 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.111467    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk" event={"ID":"c466caee-714c-47b2-a5a2-880fe2729cda","Type":"ContainerStarted","Data":"34dc725b34785e4fb4945205112904d88aa133783cd3861b95867801e661da86"}
Jul 07 15:05:00.131414 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.131356    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" podStartSLOduration=18.131336796 podStartE2EDuration="18.131336796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:00.130159301 +0000 UTC m=+257.395904278" watchObservedRunningTime="2026-07-07 15:05:00.131336796 +0000 UTC m=+257.397081771"
Jul 07 15:05:00.150139 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.150109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:00.552192 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.552156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:00.750915 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:00.750870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:01.158590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:01.158501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:01.259168 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:01.259132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:01.756163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:01.756131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:01.980097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:01.980057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:02.120162 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:02.120074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk" event={"ID":"c466caee-714c-47b2-a5a2-880fe2729cda","Type":"ContainerStarted","Data":"81de9901cd61988ab73699b90d60fca1a5599d62536ba10346411271a29dd938"}
Jul 07 15:05:02.120162 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:02.120124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk" event={"ID":"c466caee-714c-47b2-a5a2-880fe2729cda","Type":"ContainerStarted","Data":"e9fa3b2df795efb3fa9dc15a13600e9dbf9bba550c444486ab8eb5355a6baf05"}
Jul 07 15:05:02.137386 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:02.137342    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lrvbk" podStartSLOduration=17.348576769 podStartE2EDuration="19.137325849s" totalImagesPullingTime="1.78874908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:02.137192493 +0000 UTC m=+259.402937470" watchObservedRunningTime="2026-07-07 15:05:02.137325849 +0000 UTC m=+259.403070848"
Jul 07 15:05:02.804900 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:02.804865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:02.906745 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:02.906708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:03.127306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:03.127214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:03.968291 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:03.968251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:05:03.968794 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:03.968302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:05:03.968794 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:03.968777    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac12beb0-8932-4ea9-b0e8-243a71893956-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:05:03.970684 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:03.970663    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac12beb0-8932-4ea9-b0e8-243a71893956-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tkpwg\" (UID: \"ac12beb0-8932-4ea9-b0e8-243a71893956\") " pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:05:04.030966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:04.030923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tkpwg"
Jul 07 15:05:04.162621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:04.162585    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tkpwg"]
Jul 07 15:05:04.165499 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:04.165466    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac12beb0_8932_4ea9_b0e8_243a71893956.slice/crio-4bb16da94bf0bda7cb1caa3d2356347ae67c9c0dd1ec89574e651792cdff0664 WatchSource:0}: Error finding container 4bb16da94bf0bda7cb1caa3d2356347ae67c9c0dd1ec89574e651792cdff0664: Status 404 returned error can't find the container with id 4bb16da94bf0bda7cb1caa3d2356347ae67c9c0dd1ec89574e651792cdff0664
Jul 07 15:05:05.132334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:05.132108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkpwg" event={"ID":"ac12beb0-8932-4ea9-b0e8-243a71893956","Type":"ContainerStarted","Data":"4bb16da94bf0bda7cb1caa3d2356347ae67c9c0dd1ec89574e651792cdff0664"}
Jul 07 15:05:07.896075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:07.896042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:08.371367 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:08.371326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:08.913771 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:08.913733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.015226 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.015198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.117398 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.117318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.147482 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.147454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkpwg" event={"ID":"ac12beb0-8932-4ea9-b0e8-243a71893956","Type":"ContainerStarted","Data":"e2798e926c6825d4b708fe17b16b2c544488466fe3ae8f836cf0a2266b2a92a1"}
Jul 07 15:05:09.147625 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.147506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkpwg" event={"ID":"ac12beb0-8932-4ea9-b0e8-243a71893956","Type":"ContainerStarted","Data":"c8457f1f2aca79b07cfcf3b5c482b4c974fd7304279601fc4697b3da37d4dbcd"}
Jul 07 15:05:09.230871 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.230814    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.399156 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.399066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.455631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.455599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.598832 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.598789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.801279 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.801241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:09.860611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:09.860557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:10.193941 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:10.193886    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:10.403862 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:10.403827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:10.818671 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:10.818595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:11.405974 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:11.405932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:11.827067 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:11.827028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:11.928159 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:11.928128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:12.160113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:12.160034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tkpwg" event={"ID":"ac12beb0-8932-4ea9-b0e8-243a71893956","Type":"ContainerStarted","Data":"40fa9c2598a5bc6ef4dd314821019a39788abed844740152750016c8b77ad805"}
Jul 07 15:05:12.177320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:12.177265    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tkpwg" podStartSLOduration=17.070201192 podStartE2EDuration="24.17725103s" totalImagesPullingTime="7.107049838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:04:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:12.177046086 +0000 UTC m=+269.442791060" watchObservedRunningTime="2026-07-07 15:05:12.17725103 +0000 UTC m=+269.442996006"
Jul 07 15:05:12.820416 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:12.820379    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:05:12.846133 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:12.846094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:12.936180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:12.936143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:13.291651 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:13.291617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:15.229665 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:15.229620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:15.325096 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:15.325058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:17.627294 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:17.627254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:17.725850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:17.725812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:18.591323 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.591286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:18.659870 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.659836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:18.750337 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.750304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:18.761923 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.761900    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"]
Jul 07 15:05:18.764077 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.764061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:18.769605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.769584    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t4vhb\""
Jul 07 15:05:18.769896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.769878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 15:05:18.778842 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.778822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"]
Jul 07 15:05:18.848116 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.848030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:18.883220 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.883189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d952a4f1-e124-48df-8c5c-6f8b6b14c810-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7kmbk\" (UID: \"d952a4f1-e124-48df-8c5c-6f8b6b14c810\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:18.983588 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.983520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d952a4f1-e124-48df-8c5c-6f8b6b14c810-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7kmbk\" (UID: \"d952a4f1-e124-48df-8c5c-6f8b6b14c810\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:18.985963 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:18.985933    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d952a4f1-e124-48df-8c5c-6f8b6b14c810-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7kmbk\" (UID: \"d952a4f1-e124-48df-8c5c-6f8b6b14c810\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:19.073396 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:19.073343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:19.207800 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:19.207776    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"]
Jul 07 15:05:19.210154 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:19.210125    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd952a4f1_e124_48df_8c5c_6f8b6b14c810.slice/crio-1ddf000160d91804707c22326b5cce6083ef6c3d765779ccd161951af83259c3 WatchSource:0}: Error finding container 1ddf000160d91804707c22326b5cce6083ef6c3d765779ccd161951af83259c3: Status 404 returned error can't find the container with id 1ddf000160d91804707c22326b5cce6083ef6c3d765779ccd161951af83259c3
Jul 07 15:05:20.188122 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:20.188088    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk" event={"ID":"d952a4f1-e124-48df-8c5c-6f8b6b14c810","Type":"ContainerStarted","Data":"1ddf000160d91804707c22326b5cce6083ef6c3d765779ccd161951af83259c3"}
Jul 07 15:05:22.196066 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.196028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk" event={"ID":"d952a4f1-e124-48df-8c5c-6f8b6b14c810","Type":"ContainerStarted","Data":"5e0bcd0178d234484843645f81231b554f2ac9733267ae5f7442c8602cf605c7"}
Jul 07 15:05:22.196575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.196231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:22.200642 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.200612    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk"
Jul 07 15:05:22.211834 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.211792    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7kmbk" podStartSLOduration=1.78230138 podStartE2EDuration="4.211778486s" totalImagesPullingTime="2.429477106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:22.211597601 +0000 UTC m=+279.477342577" watchObservedRunningTime="2026-07-07 15:05:22.211778486 +0000 UTC m=+279.477523461"
Jul 07 15:05:22.420885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.420852    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:05:22.423200 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.423181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.426050 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426027    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:05:22.426380 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426358    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:05:22.426509 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426399    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 15:05:22.426509 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426422    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4699p\""
Jul 07 15:05:22.426509 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426472    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:05:22.426676 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 15:05:22.426839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426818    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:05:22.426945 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.426842    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:05:22.431579 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.431561    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 15:05:22.436049 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.436026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:05:22.511436 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511436 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlvk\" (UniqueName: \"kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.511672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.511597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlvk\" (UniqueName: \"kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.612508 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.612242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.613896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.613532    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.613896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.613645    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.613896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.613729    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.614157 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.613907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.614653 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.614629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.616746 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.616721    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.616850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.616747    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.622570 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.622520    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlvk\" (UniqueName: \"kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk\") pod \"console-7cf7d7885-nzwxp\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") " pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.732429 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.732376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:22.785264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.785235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:22.816999 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.816931    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"]
Jul 07 15:05:22.820095 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.820077    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:22.822961 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.822769    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 15:05:22.822961 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.822944    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:05:22.823139 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.823063    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w2vcn\""
Jul 07 15:05:22.823196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.823174    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 15:05:22.823319 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.823291    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:05:22.823419 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.823387    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:05:22.826142 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.826120    2583 patch_prober.go:28] interesting pod/image-registry-77478d4499-cvd7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 15:05:22.826257 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.826161    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:05:22.829994 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.829944    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"]
Jul 07 15:05:22.854967 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.854939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:22.863129 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.863104    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:05:22.866517 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:22.866494    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2addd489_7771_4485_80c8_ed53b5fb28a3.slice/crio-6672c64c61996a6456b982e0c283ff49b8bf0552e27286b90e24145cb8d670b7 WatchSource:0}: Error finding container 6672c64c61996a6456b982e0c283ff49b8bf0552e27286b90e24145cb8d670b7: Status 404 returned error can't find the container with id 6672c64c61996a6456b982e0c283ff49b8bf0552e27286b90e24145cb8d670b7
Jul 07 15:05:22.917057 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.917027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:22.917205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.917071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f10802a-cc5d-48a9-be88-5be1668d1786-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:22.917205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.917128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdll4\" (UniqueName: \"kubernetes.io/projected/3f10802a-cc5d-48a9-be88-5be1668d1786-kube-api-access-sdll4\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:22.917205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.917149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:22.965180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:22.965138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:23.017707 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.017677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.017849 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.017736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f10802a-cc5d-48a9-be88-5be1668d1786-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.017849 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.017777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdll4\" (UniqueName: \"kubernetes.io/projected/3f10802a-cc5d-48a9-be88-5be1668d1786-kube-api-access-sdll4\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.017849 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.017797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.018485 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.018462    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f10802a-cc5d-48a9-be88-5be1668d1786-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.020178 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.020158    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.020275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.020226    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f10802a-cc5d-48a9-be88-5be1668d1786-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.026487 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.026467    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdll4\" (UniqueName: \"kubernetes.io/projected/3f10802a-cc5d-48a9-be88-5be1668d1786-kube-api-access-sdll4\") pod \"prometheus-operator-567f7b8b7c-hmzkn\" (UID: \"3f10802a-cc5d-48a9-be88-5be1668d1786\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.132012 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.131923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"
Jul 07 15:05:23.200958 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.200928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf7d7885-nzwxp" event={"ID":"2addd489-7771-4485-80c8-ed53b5fb28a3","Type":"ContainerStarted","Data":"6672c64c61996a6456b982e0c283ff49b8bf0552e27286b90e24145cb8d670b7"}
Jul 07 15:05:23.259138 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.259028    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn"]
Jul 07 15:05:23.261497 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:23.261470    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f10802a_cc5d_48a9_be88_5be1668d1786.slice/crio-d188129a1c4d9ad8dca2c9e4823d32f728f3302c94909177665a778e10e944e6 WatchSource:0}: Error finding container d188129a1c4d9ad8dca2c9e4823d32f728f3302c94909177665a778e10e944e6: Status 404 returned error can't find the container with id d188129a1c4d9ad8dca2c9e4823d32f728f3302c94909177665a778e10e944e6
Jul 07 15:05:23.839310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:23.839268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:24.205742 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:24.205705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn" event={"ID":"3f10802a-cc5d-48a9-be88-5be1668d1786","Type":"ContainerStarted","Data":"d188129a1c4d9ad8dca2c9e4823d32f728f3302c94909177665a778e10e944e6"}
Jul 07 15:05:24.860334 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:24.860286    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mgddn" podUID="dd0a9694-7f69-467c-aeda-a4eef34a5fb5"
Jul 07 15:05:25.209974 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:25.209946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:26.175368 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.175315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:26.216630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.216581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn" event={"ID":"3f10802a-cc5d-48a9-be88-5be1668d1786","Type":"ContainerStarted","Data":"fe9db3b885eafc024184cd55bb036b7c845fafe3106f091623698687e04469a4"}
Jul 07 15:05:26.217098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.216664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn" event={"ID":"3f10802a-cc5d-48a9-be88-5be1668d1786","Type":"ContainerStarted","Data":"9a0d1dbc88917e0c1de6f975bb1a2f7b69436cf1eabed5c6cd75e0f760503133"}
Jul 07 15:05:26.218220 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.218199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf7d7885-nzwxp" event={"ID":"2addd489-7771-4485-80c8-ed53b5fb28a3","Type":"ContainerStarted","Data":"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"}
Jul 07 15:05:26.234717 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.234678    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hmzkn" podStartSLOduration=2.6161897610000002 podStartE2EDuration="4.234663561s" totalImagesPullingTime="1.6184738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:26.234039544 +0000 UTC m=+283.499784552" watchObservedRunningTime="2026-07-07 15:05:26.234663561 +0000 UTC m=+283.500408537"
Jul 07 15:05:26.254998 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:26.254937    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cf7d7885-nzwxp" podStartSLOduration=1.189426744 podStartE2EDuration="4.254911368s" totalImagesPullingTime="3.065484624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:26.25400459 +0000 UTC m=+283.519749566" watchObservedRunningTime="2026-07-07 15:05:26.254911368 +0000 UTC m=+283.520656344"
Jul 07 15:05:27.883070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:27.883028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:27.979643 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:27.979606    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.142090 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.141992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.151530 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.151495    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"]
Jul 07 15:05:28.153943 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.153923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.156451 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.156429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 15:05:28.156643 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.156620    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 15:05:28.156880 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.156865    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lszl7\""
Jul 07 15:05:28.166580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.166522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"]
Jul 07 15:05:28.174317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.174292    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bl2nc"]
Jul 07 15:05:28.176930 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.176911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.179955 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.179937    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:05:28.180065 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.180033    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwdqv\""
Jul 07 15:05:28.180125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.179937    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:05:28.180345 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.180329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:05:28.259491 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.259455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251fe446-f56f-44de-82c9-18613497c473-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.259690 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.259557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.259690 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.259589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.259690 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.259626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5vvz\" (UniqueName: \"kubernetes.io/projected/251fe446-f56f-44de-82c9-18613497c473-kube-api-access-d5vvz\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.273163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.273116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.352660 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.352615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.360432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.360589 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.360589 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5vvz\" (UniqueName: \"kubernetes.io/projected/251fe446-f56f-44de-82c9-18613497c473-kube-api-access-d5vvz\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.360589 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-textfile\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360589 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-wtmp\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqc8\" (UniqueName: \"kubernetes.io/projected/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-kube-api-access-vfqc8\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-tls\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-root\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360785    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-accelerators-collector-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.360830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251fe446-f56f-44de-82c9-18613497c473-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.361123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.360860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-sys\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.361123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.361018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-metrics-client-ca\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.361525 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.361501    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251fe446-f56f-44de-82c9-18613497c473-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.362932 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.362907    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.363062 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.363043    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251fe446-f56f-44de-82c9-18613497c473-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.369957 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.369935    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5vvz\" (UniqueName: \"kubernetes.io/projected/251fe446-f56f-44de-82c9-18613497c473-kube-api-access-d5vvz\") pod \"openshift-state-metrics-54cf96dfcf-2q8dc\" (UID: \"251fe446-f56f-44de-82c9-18613497c473\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.452556 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.452501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.461970 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.461945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-textfile\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.461980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-wtmp\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqc8\" (UniqueName: \"kubernetes.io/projected/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-kube-api-access-vfqc8\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-tls\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-root\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-accelerators-collector-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462132    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-wtmp\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-sys\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-root\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462243    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-sys\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-metrics-client-ca\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462320    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-textfile\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462723    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-accelerators-collector-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.462790 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.462746    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-metrics-client-ca\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.464327 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.464310    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-tls\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.464375 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.464354    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.464414 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.464389    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"
Jul 07 15:05:28.472623 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.472596    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqc8\" (UniqueName: \"kubernetes.io/projected/bb8507a6-08f8-4e4c-b4ca-fa09e035a841-kube-api-access-vfqc8\") pod \"node-exporter-bl2nc\" (UID: \"bb8507a6-08f8-4e4c-b4ca-fa09e035a841\") " pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.487514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.487480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bl2nc"
Jul 07 15:05:28.497378 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:28.497356    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8507a6_08f8_4e4c_b4ca_fa09e035a841.slice/crio-37005511fc8fac6022938ed637c88d67158278571d5356c77a90640277461bfd WatchSource:0}: Error finding container 37005511fc8fac6022938ed637c88d67158278571d5356c77a90640277461bfd: Status 404 returned error can't find the container with id 37005511fc8fac6022938ed637c88d67158278571d5356c77a90640277461bfd
Jul 07 15:05:28.552932 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.552891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.564761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.564733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:28.567302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.567279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd0a9694-7f69-467c-aeda-a4eef34a5fb5-metrics-tls\") pod \"dns-default-mgddn\" (UID: \"dd0a9694-7f69-467c-aeda-a4eef34a5fb5\") " pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:28.595668 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.595640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc"]
Jul 07 15:05:28.598036 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:28.598011    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251fe446_f56f_44de_82c9_18613497c473.slice/crio-5cf64e7d7e1ddfe6a8edea907a2d7bc69366b73148fd0f4349f92afb7f72b00e WatchSource:0}: Error finding container 5cf64e7d7e1ddfe6a8edea907a2d7bc69366b73148fd0f4349f92afb7f72b00e: Status 404 returned error can't find the container with id 5cf64e7d7e1ddfe6a8edea907a2d7bc69366b73148fd0f4349f92afb7f72b00e
Jul 07 15:05:28.652710 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.652684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.757822 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.757783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:28.813735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.813709    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bp52v\""
Jul 07 15:05:28.821902 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.821880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:28.951105 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.951079    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mgddn"]
Jul 07 15:05:28.953366 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:28.953314    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0a9694_7f69_467c_aeda_a4eef34a5fb5.slice/crio-6611587ec77fdb0cd3e1acc345aef28c0503f18d2b48a50f12a967e873a033a2 WatchSource:0}: Error finding container 6611587ec77fdb0cd3e1acc345aef28c0503f18d2b48a50f12a967e873a033a2: Status 404 returned error can't find the container with id 6611587ec77fdb0cd3e1acc345aef28c0503f18d2b48a50f12a967e873a033a2
Jul 07 15:05:28.962107 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:28.962082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:29.059410 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.059373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:29.179020 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.178986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:29.231522 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.231415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mgddn" event={"ID":"dd0a9694-7f69-467c-aeda-a4eef34a5fb5","Type":"ContainerStarted","Data":"6611587ec77fdb0cd3e1acc345aef28c0503f18d2b48a50f12a967e873a033a2"}
Jul 07 15:05:29.232920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.232890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bl2nc" event={"ID":"bb8507a6-08f8-4e4c-b4ca-fa09e035a841","Type":"ContainerStarted","Data":"37005511fc8fac6022938ed637c88d67158278571d5356c77a90640277461bfd"}
Jul 07 15:05:29.234989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.234958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc" event={"ID":"251fe446-f56f-44de-82c9-18613497c473","Type":"ContainerStarted","Data":"14e9c85d5bc17c08ab6460a5d9b9c1a208219e0b0309f282f88db18b3478c82b"}
Jul 07 15:05:29.235102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.235013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc" event={"ID":"251fe446-f56f-44de-82c9-18613497c473","Type":"ContainerStarted","Data":"d35966244923968f230055c22f4bcfe2b9a50d09aab124bdc13cb7bcc9cf7a7e"}
Jul 07 15:05:29.235102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.235040    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc" event={"ID":"251fe446-f56f-44de-82c9-18613497c473","Type":"ContainerStarted","Data":"5cf64e7d7e1ddfe6a8edea907a2d7bc69366b73148fd0f4349f92afb7f72b00e"}
Jul 07 15:05:29.258053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.258008    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 15:05:29.261206 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.261183    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.264152 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.263963    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 15:05:29.264268 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264153    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 15:05:29.264334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264294    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264635    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264688    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264716    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xvs56\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264724    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 15:05:29.264840 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264644    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 15:05:29.265179 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.264904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 15:05:29.282721 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.278936    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 15:05:29.295760 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.295692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:29.372243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-out\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372401 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372286    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372401 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-web-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372401 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372338    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372401 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.372673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.372651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7t68\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-kube-api-access-f7t68\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7t68\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-kube-api-access-f7t68\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-out\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.473981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.474004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-web-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.474036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.474073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.474111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.474783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.474477    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.475590 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:29.474981    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle podName:4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:29.974958181 +0000 UTC m=+287.240703148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894") : configmap references non-existent config key: ca-bundle.crt
Jul 07 15:05:29.476624 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:29.476052    2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 07 15:05:29.476624 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:29.476110    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls podName:4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:29.976093003 +0000 UTC m=+287.241837959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894") : secret "alertmanager-main-tls" not found
Jul 07 15:05:29.476624 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.476510    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.479311 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.479278    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-out\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.479774 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.479749    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.480183 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.480133    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.482091 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.481900    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.482789 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.482755    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.483111 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.483092    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.483202 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.483179    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.483891 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.483852    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7t68\" (UniqueName: \"kubernetes.io/projected/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-kube-api-access-f7t68\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.484245 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.484211    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-web-config\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.559943 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.559891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:29.979270 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.978768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.979270 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.978853    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.979812 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.979759    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:29.981863 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:29.981816    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:30.174276 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.174237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 15:05:30.241343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.241303    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb8507a6-08f8-4e4c-b4ca-fa09e035a841" containerID="dd8629bc5c2bdf4aa41e6769bb9f9248ea7e0282272d604c76a8e997f249cd53" exitCode=0
Jul 07 15:05:30.241343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.241348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bl2nc" event={"ID":"bb8507a6-08f8-4e4c-b4ca-fa09e035a841","Type":"ContainerDied","Data":"dd8629bc5c2bdf4aa41e6769bb9f9248ea7e0282272d604c76a8e997f249cd53"}
Jul 07 15:05:30.269068 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.269030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:30.327492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.327456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:30.727907 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:30.727869    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 15:05:30.732773 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:30.732730    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5a96ca_ef7d_46a7_bdcf_9a2d4ada3894.slice/crio-5b6472170c2f07a0ffc2b9e37a2dec599ea59938bad1f2b4bdb1d354d425e45d WatchSource:0}: Error finding container 5b6472170c2f07a0ffc2b9e37a2dec599ea59938bad1f2b4bdb1d354d425e45d: Status 404 returned error can't find the container with id 5b6472170c2f07a0ffc2b9e37a2dec599ea59938bad1f2b4bdb1d354d425e45d
Jul 07 15:05:31.081672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.081638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:31.168999 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.168957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:31.247816 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.247784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mgddn" event={"ID":"dd0a9694-7f69-467c-aeda-a4eef34a5fb5","Type":"ContainerStarted","Data":"348754430c3676bc622174c6d6dbc8bd19f4680d4f9050387044e3e85b72c5af"}
Jul 07 15:05:31.247988 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.247836    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mgddn" event={"ID":"dd0a9694-7f69-467c-aeda-a4eef34a5fb5","Type":"ContainerStarted","Data":"db8a672e14c8e75057770e3945107ad73280163284d5ec7cd4ae3e8dfbd3d124"}
Jul 07 15:05:31.247988 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.247895    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:31.253021 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.252994    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bl2nc" event={"ID":"bb8507a6-08f8-4e4c-b4ca-fa09e035a841","Type":"ContainerStarted","Data":"79efeaf311eb9466a3fad37617c6d1724d1f141614e5d3138ed288b8a600023a"}
Jul 07 15:05:31.253175 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.253050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bl2nc" event={"ID":"bb8507a6-08f8-4e4c-b4ca-fa09e035a841","Type":"ContainerStarted","Data":"4fc4fbddea7a3620decfceed8ef231538acc2ad97b5d80dc80b0cd1db9dc6040"}
Jul 07 15:05:31.255176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.255152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc" event={"ID":"251fe446-f56f-44de-82c9-18613497c473","Type":"ContainerStarted","Data":"111215a80af57ecb071aa0a47645c20a4d33c9a73dfa09bd0af12a6765d7d5fb"}
Jul 07 15:05:31.256194 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.256175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"5b6472170c2f07a0ffc2b9e37a2dec599ea59938bad1f2b4bdb1d354d425e45d"}
Jul 07 15:05:31.265446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.265406    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mgddn" podStartSLOduration=251.655469739 podStartE2EDuration="4m13.26539479s" totalImagesPullingTime="1.609925051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:31.263969731 +0000 UTC m=+288.529714706" watchObservedRunningTime="2026-07-07 15:05:31.26539479 +0000 UTC m=+288.531139764"
Jul 07 15:05:31.283673 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.283625    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2q8dc" podStartSLOduration=1.427528454 podStartE2EDuration="3.283609465s" totalImagesPullingTime="1.856081011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:31.283011583 +0000 UTC m=+288.548756553" watchObservedRunningTime="2026-07-07 15:05:31.283609465 +0000 UTC m=+288.549354418"
Jul 07 15:05:31.301761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.301714    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bl2nc" podStartSLOduration=1.955308927 podStartE2EDuration="3.301701226s" totalImagesPullingTime="1.261041996s" totalInitContainerRuntime="85.350303ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:31.301111135 +0000 UTC m=+288.566856110" watchObservedRunningTime="2026-07-07 15:05:31.301701226 +0000 UTC m=+288.567446200"
Jul 07 15:05:31.362851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.362761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:31.422528 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:31.422492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:32.264079 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.264045    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894" containerID="5974c78939eea93bc88aefa81d4b9a1db2ca707b0c925f044dcca3cf5d9cff76" exitCode=0
Jul 07 15:05:32.264516 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.264129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerDied","Data":"5974c78939eea93bc88aefa81d4b9a1db2ca707b0c925f044dcca3cf5d9cff76"}
Jul 07 15:05:32.642799 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.642760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:32.701046 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.701017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:32.733042 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.733015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:32.733203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.733100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:32.734474 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.734450    2583 patch_prober.go:28] interesting pod/console-7cf7d7885-nzwxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 07 15:05:32.734590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.734495    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7cf7d7885-nzwxp" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 07 15:05:32.824829 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.824798    2583 patch_prober.go:28] interesting pod/image-registry-77478d4499-cvd7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 15:05:32.824959 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:32.824843    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:05:33.006417 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.006383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:33.015159 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.015127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"]
Jul 07 15:05:33.017710 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.017689    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.021708 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.021685    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 15:05:33.021708 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.021705    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qf62p\""
Jul 07 15:05:33.027711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.027687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"]
Jul 07 15:05:33.088352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.088320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:33.103576 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.103523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/921c120b-1b27-44c1-a29e-7b2989fb3a51-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.103735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.103596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2v8\" (UniqueName: \"kubernetes.io/projected/921c120b-1b27-44c1-a29e-7b2989fb3a51-kube-api-access-kf2v8\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.204797 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.204762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/921c120b-1b27-44c1-a29e-7b2989fb3a51-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.204968 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.204824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2v8\" (UniqueName: \"kubernetes.io/projected/921c120b-1b27-44c1-a29e-7b2989fb3a51-kube-api-access-kf2v8\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.207695 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.207670    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/921c120b-1b27-44c1-a29e-7b2989fb3a51-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.214404 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.214380    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2v8\" (UniqueName: \"kubernetes.io/projected/921c120b-1b27-44c1-a29e-7b2989fb3a51-kube-api-access-kf2v8\") pod \"monitoring-plugin-d5dcff7cf-rqtbj\" (UID: \"921c120b-1b27-44c1-a29e-7b2989fb3a51\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.327455 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.327363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:33.451289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:33.451251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"]
Jul 07 15:05:33.453952 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:05:33.453918    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921c120b_1b27_44c1_a29e_7b2989fb3a51.slice/crio-2fa446bb9d6779a7f7df7d206659151324646f79b21f2ebf6ddad032ae2e50e7 WatchSource:0}: Error finding container 2fa446bb9d6779a7f7df7d206659151324646f79b21f2ebf6ddad032ae2e50e7: Status 404 returned error can't find the container with id 2fa446bb9d6779a7f7df7d206659151324646f79b21f2ebf6ddad032ae2e50e7
Jul 07 15:05:34.274554 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:34.274500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj" event={"ID":"921c120b-1b27-44c1-a29e-7b2989fb3a51","Type":"ContainerStarted","Data":"2fa446bb9d6779a7f7df7d206659151324646f79b21f2ebf6ddad032ae2e50e7"}
Jul 07 15:05:34.581469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:34.581389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:35.282895 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.282858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj" event={"ID":"921c120b-1b27-44c1-a29e-7b2989fb3a51","Type":"ContainerStarted","Data":"14817652111b84566a4ab1498ed627865e31e6ace800e3c1b81915995d2b878f"}
Jul 07 15:05:35.283017 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.282910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:35.283602 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.283571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"af9852410d85a208e18f520b3223f129bf2b01fcaff56f142b53b3c84af2501a"}
Jul 07 15:05:35.283697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.283648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"670243ab7abdf9dc27a7bfb52e64807306d6da39373806ca4adab258a66bf6de"}
Jul 07 15:05:35.283697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.283689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"4d86208ea9b78fdec02626b0b2fd7e5bad6d5120a74f1e5805f6be7ae3c6d4bb"}
Jul 07 15:05:35.285639 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.285619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj"
Jul 07 15:05:35.299458 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:35.299416    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rqtbj" podStartSLOduration=1.70135566 podStartE2EDuration="3.299399078s" totalImagesPullingTime="1.598043418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:35.297627194 +0000 UTC m=+292.563372170" watchObservedRunningTime="2026-07-07 15:05:35.299399078 +0000 UTC m=+292.565144054"
Jul 07 15:05:36.291222 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:36.291188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"f63d8b5168f11854154b717f192a9d2554b46464b7c36264b252ad95dd1f9620"}
Jul 07 15:05:36.291626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:36.291277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"d5112688ee69c13b9eeeabcb76c42d23dde0be750938a500f50404f696192b54"}
Jul 07 15:05:37.044848 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.044811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:37.299609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.299506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894","Type":"ContainerStarted","Data":"53fbbafbf63f328acdee28af8eec69107567cb84932ed17f8f9474bf38440e57"}
Jul 07 15:05:37.329063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.329009    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.173532628 podStartE2EDuration="8.328994232s" totalImagesPullingTime="5.136031234s" totalInitContainerRuntime="19.43037ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:37.327502215 +0000 UTC m=+294.593247190" watchObservedRunningTime="2026-07-07 15:05:37.328994232 +0000 UTC m=+294.594739206"
Jul 07 15:05:37.840308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.840268    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry" containerID="cri-o://a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0" gracePeriod=30
Jul 07 15:05:37.887048 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.887018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:37.988226 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:37.988189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:38.077719 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.077695    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:05:38.152346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152260    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152298    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152324    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152401    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbggw\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152448    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152516    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") pod \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\" (UID: \"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24\") "
Jul 07 15:05:38.152868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152742    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:05:38.152868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.152810    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:05:38.154898 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.154871    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:05:38.155068 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.155045    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:05:38.155152 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.155136    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw" (OuterVolumeSpecName: "kube-api-access-qbggw") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "kube-api-access-qbggw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:05:38.155226 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.155205    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:05:38.155302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.155281    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:05:38.163177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.163150    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" (UID: "ede4bfcb-fe77-43d5-9fa3-565b5c6dba24"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:05:38.253624 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253592    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253624 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253617    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-registry-certificates\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253624 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253626    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-ca-trust-extracted\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253634    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-trusted-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253642    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-bound-sa-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253649    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbggw\" (UniqueName: \"kubernetes.io/projected/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-kube-api-access-qbggw\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253658    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-image-registry-private-configuration\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.253824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.253666    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24-installation-pull-secrets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.303877 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.303847    2583 generic.go:356] "Generic (PLEG): container finished" podID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerID="a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0" exitCode=0
Jul 07 15:05:38.304244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.303888    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77478d4499-cvd7j"
Jul 07 15:05:38.304244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.303930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" event={"ID":"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24","Type":"ContainerDied","Data":"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"}
Jul 07 15:05:38.304244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.303977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77478d4499-cvd7j" event={"ID":"ede4bfcb-fe77-43d5-9fa3-565b5c6dba24","Type":"ContainerDied","Data":"b545f346d2940a9457c9ce48b0fb81b343bf9ef9d91a84344e03e688e757e77a"}
Jul 07 15:05:38.304244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.304001    2583 scope.go:117] "RemoveContainer" containerID="a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"
Jul 07 15:05:38.312438 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.312413    2583 scope.go:117] "RemoveContainer" containerID="a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"
Jul 07 15:05:38.312732 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:38.312704    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0\": container with ID starting with a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0 not found: ID does not exist" containerID="a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"
Jul 07 15:05:38.312807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.312740    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0"} err="failed to get container status \"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0\": rpc error: code = NotFound desc = could not find container \"a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0\": container with ID starting with a39498bfa10d5db4d6d44651c14bf3f4ed2cbcfe254945672dccb77ac1120de0 not found: ID does not exist"
Jul 07 15:05:38.325237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.325212    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:05:38.331466 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:38.331444    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77478d4499-cvd7j"]
Jul 07 15:05:39.284104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:39.284067    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" path="/var/lib/kubelet/pods/ede4bfcb-fe77-43d5-9fa3-565b5c6dba24/volumes"
Jul 07 15:05:40.279238 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:05:40.279197    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9v6gc" podUID="19582102-62e4-4d46-821e-d05b20aede59"
Jul 07 15:05:41.267173 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:41.267138    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mgddn"
Jul 07 15:05:42.736914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:42.736884    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:42.741404 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:42.741374    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:05:42.896313 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:42.896265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:42.995850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:42.995723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:43.162271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:43.162247    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:05:43.441821 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:43.441789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:43.619608 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:43.504455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:44.653635 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:44.653594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:44.903802 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:44.903714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:45.003930 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:45.003901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:48.997100 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:48.997046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:49.098071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:49.098032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:52.360564 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:52.360509    2583 generic.go:356] "Generic (PLEG): container finished" podID="25d905e1-27ca-4063-8cc9-5cb80c4fd12b" containerID="a83da66f318a4882b2445dbee6fb23928527c32ecfd3823d5d8ae870afb7ac39" exitCode=0
Jul 07 15:05:52.361028 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:52.360583    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd" event={"ID":"25d905e1-27ca-4063-8cc9-5cb80c4fd12b","Type":"ContainerDied","Data":"a83da66f318a4882b2445dbee6fb23928527c32ecfd3823d5d8ae870afb7ac39"}
Jul 07 15:05:52.361028 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:52.360966    2583 scope.go:117] "RemoveContainer" containerID="a83da66f318a4882b2445dbee6fb23928527c32ecfd3823d5d8ae870afb7ac39"
Jul 07 15:05:52.908271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:52.908239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:53.281569 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.280277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:05:53.291365 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.291330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:53.365947 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.365913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hkjjd" event={"ID":"25d905e1-27ca-4063-8cc9-5cb80c4fd12b","Type":"ContainerStarted","Data":"2f4676c885288e02e3cdc60fb429d83a008d30bb02ba8a37d629814b4ca18df2"}
Jul 07 15:05:53.486090 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.486054    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:05:53.588039 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.587949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:53.697018 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.696988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:05:53.754052 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:05:53.754015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:06.977332 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:06.977293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:07.033490 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:07.033455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:07.895620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:07.895585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:07.964037 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:07.963998    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:18.286194 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.286159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:18.384419 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.384385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:18.506687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.506642    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cf7d7885-nzwxp" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerName="console" containerID="cri-o://f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab" gracePeriod=15
Jul 07 15:06:18.757250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.757226    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:06:18.892333 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892226    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dlvk\" (UniqueName: \"kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892333 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892333 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892333 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892344    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892578    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert\") pod \"2addd489-7771-4485-80c8-ed53b5fb28a3\" (UID: \"2addd489-7771-4485-80c8-ed53b5fb28a3\") "
Jul 07 15:06:18.892862 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892743    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:18.892921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892879    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:18.892972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892936    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:18.892972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.892935    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config" (OuterVolumeSpecName: "console-config") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:18.893074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.893061    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.893146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.893079    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-oauth-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.893146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.893100    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-console-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.893146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.893109    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2addd489-7771-4485-80c8-ed53b5fb28a3-trusted-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.894722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.894695    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk" (OuterVolumeSpecName: "kube-api-access-9dlvk") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "kube-api-access-9dlvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:18.894722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.894712    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:06:18.894865 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.894699    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2addd489-7771-4485-80c8-ed53b5fb28a3" (UID: "2addd489-7771-4485-80c8-ed53b5fb28a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:06:18.993666 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.993627    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dlvk\" (UniqueName: \"kubernetes.io/projected/2addd489-7771-4485-80c8-ed53b5fb28a3-kube-api-access-9dlvk\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.993666 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.993659    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-oauth-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:18.993666 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:18.993672    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2addd489-7771-4485-80c8-ed53b5fb28a3-console-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:06:19.464295 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.464262    2583 generic.go:356] "Generic (PLEG): container finished" podID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerID="f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab" exitCode=0
Jul 07 15:06:19.464734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.464320    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf7d7885-nzwxp"
Jul 07 15:06:19.464734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.464331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf7d7885-nzwxp" event={"ID":"2addd489-7771-4485-80c8-ed53b5fb28a3","Type":"ContainerDied","Data":"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"}
Jul 07 15:06:19.464734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.464370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf7d7885-nzwxp" event={"ID":"2addd489-7771-4485-80c8-ed53b5fb28a3","Type":"ContainerDied","Data":"6672c64c61996a6456b982e0c283ff49b8bf0552e27286b90e24145cb8d670b7"}
Jul 07 15:06:19.464734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.464390    2583 scope.go:117] "RemoveContainer" containerID="f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"
Jul 07 15:06:19.473068 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.473046    2583 scope.go:117] "RemoveContainer" containerID="f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"
Jul 07 15:06:19.473352 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:06:19.473335    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab\": container with ID starting with f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab not found: ID does not exist" containerID="f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"
Jul 07 15:06:19.473402 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.473359    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab"} err="failed to get container status \"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab\": rpc error: code = NotFound desc = could not find container \"f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab\": container with ID starting with f7bb0c6ae01efd46dca36ecfd6293a8d72819fcfacb8626f56b841ef37c21aab not found: ID does not exist"
Jul 07 15:06:19.481297 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.481273    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:06:19.486877 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:19.486855    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cf7d7885-nzwxp"]
Jul 07 15:06:21.282450 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:21.282414    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" path="/var/lib/kubelet/pods/2addd489-7771-4485-80c8-ed53b5fb28a3/volumes"
Jul 07 15:06:30.111582 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:30.111533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:30.211868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:30.211834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:30.267691 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:30.267653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:47.439196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:47.439156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:47.880602 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:47.880500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:52.554335 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554302    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"]
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554602    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerName="console"
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554616    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerName="console"
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554634    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry"
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554640    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry"
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554682    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede4bfcb-fe77-43d5-9fa3-565b5c6dba24" containerName="registry"
Jul 07 15:06:52.554735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.554691    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2addd489-7771-4485-80c8-ed53b5fb28a3" containerName="console"
Jul 07 15:06:52.559013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.558993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.561981 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.561953    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bdtt8\""
Jul 07 15:06:52.562180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.562160    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 15:06:52.562296 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.562274    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 15:06:52.562403 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.562380    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 15:06:52.562518 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.562431    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 15:06:52.563225 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.563206    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 15:06:52.568585 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.568563    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 15:06:52.572430 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.572407    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"]
Jul 07 15:06:52.660514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-serving-certs-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2qff\" (UniqueName: \"kubernetes.io/projected/54a674f8-6368-4078-b08f-a08a95f27aca-kube-api-access-z2qff\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-federate-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-metrics-client-ca\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660744 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.660897 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.660756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.761945 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.761916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-serving-certs-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.761945 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.761948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2qff\" (UniqueName: \"kubernetes.io/projected/54a674f8-6368-4078-b08f-a08a95f27aca-kube-api-access-z2qff\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.761974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-federate-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.761998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762527 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.762488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-metrics-client-ca\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.762575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.762637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.762794 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.762692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.763230 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.763201    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-serving-certs-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.763687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.763662    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.764076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.763690    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54a674f8-6368-4078-b08f-a08a95f27aca-metrics-client-ca\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.768660 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.768632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.769795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.769774    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-federate-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.769899 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.769866    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-secret-telemeter-client\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.770091 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.770075    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54a674f8-6368-4078-b08f-a08a95f27aca-telemeter-client-tls\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.771738 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.771717    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2qff\" (UniqueName: \"kubernetes.io/projected/54a674f8-6368-4078-b08f-a08a95f27aca-kube-api-access-z2qff\") pod \"telemeter-client-59f68bcff4-lvwt2\" (UID: \"54a674f8-6368-4078-b08f-a08a95f27aca\") " pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:52.869682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:52.869576    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"
Jul 07 15:06:53.000463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:53.000426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f68bcff4-lvwt2"]
Jul 07 15:06:53.003770 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:06:53.003738    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a674f8_6368_4078_b08f_a08a95f27aca.slice/crio-f6151ca83595212fd41b6d656cb97af9c997e42539c491b032163017e6215a97 WatchSource:0}: Error finding container f6151ca83595212fd41b6d656cb97af9c997e42539c491b032163017e6215a97: Status 404 returned error can't find the container with id f6151ca83595212fd41b6d656cb97af9c997e42539c491b032163017e6215a97
Jul 07 15:06:53.006148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:53.006130    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:06:53.591604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:53.591569    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2" event={"ID":"54a674f8-6368-4078-b08f-a08a95f27aca","Type":"ContainerStarted","Data":"f6151ca83595212fd41b6d656cb97af9c997e42539c491b032163017e6215a97"}
Jul 07 15:06:55.600944 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:55.600908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2" event={"ID":"54a674f8-6368-4078-b08f-a08a95f27aca","Type":"ContainerStarted","Data":"83982262b634aacd674ebdd2fca075540bf693cfcb2208067f770a90ac0de11b"}
Jul 07 15:06:55.601435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:55.600970    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2" event={"ID":"54a674f8-6368-4078-b08f-a08a95f27aca","Type":"ContainerStarted","Data":"204cd55b1ff27a8a1deb5ff055c4f50b3994d0d43caf73b12dec4e76665bb10f"}
Jul 07 15:06:55.601435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:55.600999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2" event={"ID":"54a674f8-6368-4078-b08f-a08a95f27aca","Type":"ContainerStarted","Data":"54aa12916e219d68fd0d0a42e3c913c1da1bc2f088c21ad0855e6e0c8e6fad1c"}
Jul 07 15:06:55.625933 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:55.625877    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59f68bcff4-lvwt2" podStartSLOduration=1.603658844 podStartE2EDuration="3.625863027s" totalImagesPullingTime="2.022204183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:55.625005751 +0000 UTC m=+372.890750726" watchObservedRunningTime="2026-07-07 15:06:55.625863027 +0000 UTC m=+372.891608002"
Jul 07 15:06:56.273676 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.273644    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:06:56.279282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.277835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.281181 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.281160    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:06:56.281370 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.281353    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4699p\""
Jul 07 15:06:56.282926 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.282906    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:06:56.283053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.282929    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 15:06:56.283053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.282911    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:06:56.283053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.282929    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 15:06:56.283053 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.283025    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:06:56.283248 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.282911    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:06:56.288802 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.288781    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 15:06:56.292997 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.292977    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:06:56.326570 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.326520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:56.392395 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392601 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392601 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392601 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpk7n\" (UniqueName: \"kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392601 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392601 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.392781 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.392613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.453000 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.452965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:56.493712 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.493856 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.493856 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.493856 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.493856 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpk7n\" (UniqueName: \"kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494000 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494000 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.493911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494504 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.494470    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494668 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.494620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494742 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.494667    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.494742 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.494694    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.496329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.496310    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.496430 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.496415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.502585 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.502564    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpk7n\" (UniqueName: \"kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n\") pod \"console-6fc6dd74cf-br4k2\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") " pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.588927 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.588835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:06:56.735847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:56.735814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:06:56.736626 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:06:56.736591    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a31c32_8a15_4d62_a753_e73a90d73379.slice/crio-b6b30c3d82a00e077058855aee21ab8b8623e1ea53d0530e2ceda0acc5f9a850 WatchSource:0}: Error finding container b6b30c3d82a00e077058855aee21ab8b8623e1ea53d0530e2ceda0acc5f9a850: Status 404 returned error can't find the container with id b6b30c3d82a00e077058855aee21ab8b8623e1ea53d0530e2ceda0acc5f9a850
Jul 07 15:06:57.100660 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.100625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:06:57.102918 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.102896    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19582102-62e4-4d46-821e-d05b20aede59-metrics-certs\") pod \"network-metrics-daemon-9v6gc\" (UID: \"19582102-62e4-4d46-821e-d05b20aede59\") " pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:06:57.185055 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.185022    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbwr6\""
Jul 07 15:06:57.191751 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.191728    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9v6gc"
Jul 07 15:06:57.276249 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.276200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:57.321428 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.321406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9v6gc"]
Jul 07 15:06:57.323800 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:06:57.323778    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19582102_62e4_4d46_821e_d05b20aede59.slice/crio-7566352d484881cd86542a483660b7edcb9771e6a3620e57072fcf51391baed3 WatchSource:0}: Error finding container 7566352d484881cd86542a483660b7edcb9771e6a3620e57072fcf51391baed3: Status 404 returned error can't find the container with id 7566352d484881cd86542a483660b7edcb9771e6a3620e57072fcf51391baed3
Jul 07 15:06:57.377158 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.377024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:57.612200 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.612159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v6gc" event={"ID":"19582102-62e4-4d46-821e-d05b20aede59","Type":"ContainerStarted","Data":"7566352d484881cd86542a483660b7edcb9771e6a3620e57072fcf51391baed3"}
Jul 07 15:06:57.613512 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.613490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6dd74cf-br4k2" event={"ID":"50a31c32-8a15-4d62-a753-e73a90d73379","Type":"ContainerStarted","Data":"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"}
Jul 07 15:06:57.613512 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.613523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6dd74cf-br4k2" event={"ID":"50a31c32-8a15-4d62-a753-e73a90d73379","Type":"ContainerStarted","Data":"b6b30c3d82a00e077058855aee21ab8b8623e1ea53d0530e2ceda0acc5f9a850"}
Jul 07 15:06:57.632842 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:57.632762    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc6dd74cf-br4k2" podStartSLOduration=1.632747378 podStartE2EDuration="1.632747378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:57.631844854 +0000 UTC m=+374.897589844" watchObservedRunningTime="2026-07-07 15:06:57.632747378 +0000 UTC m=+374.898492353"
Jul 07 15:06:59.624184 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.624147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v6gc" event={"ID":"19582102-62e4-4d46-821e-d05b20aede59","Type":"ContainerStarted","Data":"1b141cfd0f851f52d9c2227419cab7b207b2c791ab8540e0ce341c051c77fd08"}
Jul 07 15:06:59.624605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.624199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9v6gc" event={"ID":"19582102-62e4-4d46-821e-d05b20aede59","Type":"ContainerStarted","Data":"114e364e24390fe9218b10aa0e84fe1af80262e44c70f4f394293e514099eb1b"}
Jul 07 15:06:59.643569 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.642096    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9v6gc" podStartSLOduration=375.061215279 podStartE2EDuration="6m16.642075724s" totalImagesPullingTime="1.580860445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:59.639272216 +0000 UTC m=+376.905017191" watchObservedRunningTime="2026-07-07 15:06:59.642075724 +0000 UTC m=+376.907820699"
Jul 07 15:06:59.767284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.767245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:59.826664 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.826624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:06:59.881519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:06:59.881435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:02.654372 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:02.654342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:02.711301 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:02.711263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:06.589319 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.589264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:06.589749 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.589342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:06.594091 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.594066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:06.654275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.654246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:06.772031 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.771995    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd67cd9d8-sdxmd"]
Jul 07 15:07:06.775120 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.775103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.787425 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.787399    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd67cd9d8-sdxmd"]
Jul 07 15:07:06.881851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-oauth-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.881851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dj8\" (UniqueName: \"kubernetes.io/projected/203b9324-3b69-409a-8368-cfca71930e46-kube-api-access-v6dj8\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.882070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-oauth-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.882070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-trusted-ca-bundle\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.882070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-console-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.882070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.881949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-service-ca\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.882217 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.882060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-service-ca\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-oauth-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dj8\" (UniqueName: \"kubernetes.io/projected/203b9324-3b69-409a-8368-cfca71930e46-kube-api-access-v6dj8\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-oauth-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-trusted-ca-bundle\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.983803 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.983456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-console-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.984166 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.984141    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-service-ca\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.984249 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.984182    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-console-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.984249 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.984214    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-oauth-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.984429 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.984407    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/203b9324-3b69-409a-8368-cfca71930e46-trusted-ca-bundle\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.985922 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.985903    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-serving-cert\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.986010 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.985993    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/203b9324-3b69-409a-8368-cfca71930e46-console-oauth-config\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:06.991324 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:06.991303    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dj8\" (UniqueName: \"kubernetes.io/projected/203b9324-3b69-409a-8368-cfca71930e46-kube-api-access-v6dj8\") pod \"console-cd67cd9d8-sdxmd\" (UID: \"203b9324-3b69-409a-8368-cfca71930e46\") " pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:07.084238 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.084198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:07.158518 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.158490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:07.219984 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.219958    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd67cd9d8-sdxmd"]
Jul 07 15:07:07.222641 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:07:07.222607    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203b9324_3b69_409a_8368_cfca71930e46.slice/crio-4bb250f23b317aeb25c70fd969d71f6e4774e34897e3cb24d37aa17484c8e41d WatchSource:0}: Error finding container 4bb250f23b317aeb25c70fd969d71f6e4774e34897e3cb24d37aa17484c8e41d: Status 404 returned error can't find the container with id 4bb250f23b317aeb25c70fd969d71f6e4774e34897e3cb24d37aa17484c8e41d
Jul 07 15:07:07.229642 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.229619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:07.655728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.655688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd67cd9d8-sdxmd" event={"ID":"203b9324-3b69-409a-8368-cfca71930e46","Type":"ContainerStarted","Data":"42695f86934d5c12a004c3824d181b9f63484763bf9b07d5558399ced938365d"}
Jul 07 15:07:07.655728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.655734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd67cd9d8-sdxmd" event={"ID":"203b9324-3b69-409a-8368-cfca71930e46","Type":"ContainerStarted","Data":"4bb250f23b317aeb25c70fd969d71f6e4774e34897e3cb24d37aa17484c8e41d"}
Jul 07 15:07:07.674131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.674081    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd67cd9d8-sdxmd" podStartSLOduration=1.674065953 podStartE2EDuration="1.674065953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:07:07.672995736 +0000 UTC m=+384.938740712" watchObservedRunningTime="2026-07-07 15:07:07.674065953 +0000 UTC m=+384.939810927"
Jul 07 15:07:07.751763 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.751727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:07.810493 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:07.810458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:14.603176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:14.603147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:14.661976 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:14.661946    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:17.085143 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.085100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:17.085564 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.085208    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:17.090029 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.090007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:17.698120 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.698094    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd67cd9d8-sdxmd"
Jul 07 15:07:17.747232 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.747193    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:07:17.844417 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.844378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:17.944521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:17.944487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:18.002855 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:18.002766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:22.900435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:22.900403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:23.003851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:23.003812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:23.058316 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:23.058276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:42.767228 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:42.767164    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fc6dd74cf-br4k2" podUID="50a31c32-8a15-4d62-a753-e73a90d73379" containerName="console" containerID="cri-o://c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279" gracePeriod=15
Jul 07 15:07:42.999483 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:42.999456    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:43.059616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059508    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.059766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.059766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059642    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpk7n\" (UniqueName: \"kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.059766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059663    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.059766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.059766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059731    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.060027 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.059781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle\") pod \"50a31c32-8a15-4d62-a753-e73a90d73379\" (UID: \"50a31c32-8a15-4d62-a753-e73a90d73379\") "
Jul 07 15:07:43.060196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.060160    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config" (OuterVolumeSpecName: "console-config") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:07:43.060282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.060096    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca" (OuterVolumeSpecName: "service-ca") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:07:43.060282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.060099    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:07:43.060282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.060270    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:07:43.061746 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.061714    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:07:43.061853 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.061822    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:07:43.061912 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.061889    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n" (OuterVolumeSpecName: "kube-api-access-cpk7n") pod "50a31c32-8a15-4d62-a753-e73a90d73379" (UID: "50a31c32-8a15-4d62-a753-e73a90d73379"). InnerVolumeSpecName "kube-api-access-cpk7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:07:43.160575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160529    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-oauth-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160569    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpk7n\" (UniqueName: \"kubernetes.io/projected/50a31c32-8a15-4d62-a753-e73a90d73379-kube-api-access-cpk7n\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160579    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160587    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-console-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160595    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-oauth-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160603    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a31c32-8a15-4d62-a753-e73a90d73379-trusted-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.160791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.160611    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50a31c32-8a15-4d62-a753-e73a90d73379-console-serving-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:07:43.797594 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.797533    2583 generic.go:356] "Generic (PLEG): container finished" podID="50a31c32-8a15-4d62-a753-e73a90d73379" containerID="c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279" exitCode=0
Jul 07 15:07:43.797985 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.797606    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6dd74cf-br4k2"
Jul 07 15:07:43.797985 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.797637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6dd74cf-br4k2" event={"ID":"50a31c32-8a15-4d62-a753-e73a90d73379","Type":"ContainerDied","Data":"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"}
Jul 07 15:07:43.797985 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.797690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6dd74cf-br4k2" event={"ID":"50a31c32-8a15-4d62-a753-e73a90d73379","Type":"ContainerDied","Data":"b6b30c3d82a00e077058855aee21ab8b8623e1ea53d0530e2ceda0acc5f9a850"}
Jul 07 15:07:43.797985 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.797718    2583 scope.go:117] "RemoveContainer" containerID="c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"
Jul 07 15:07:43.805692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.805676    2583 scope.go:117] "RemoveContainer" containerID="c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"
Jul 07 15:07:43.805945 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:07:43.805929    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279\": container with ID starting with c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279 not found: ID does not exist" containerID="c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"
Jul 07 15:07:43.805989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.805953    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279"} err="failed to get container status \"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279\": rpc error: code = NotFound desc = could not find container \"c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279\": container with ID starting with c189a9cae122500d7deb0c60ff336fcda7cf67b9b01528538f23d571e28b2279 not found: ID does not exist"
Jul 07 15:07:43.814154 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.814128    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:07:43.818275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:43.818255    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc6dd74cf-br4k2"]
Jul 07 15:07:45.283765 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:45.283728    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50a31c32-8a15-4d62-a753-e73a90d73379" path="/var/lib/kubelet/pods/50a31c32-8a15-4d62-a753-e73a90d73379/volumes"
Jul 07 15:07:49.347469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:49.347432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:49.444494 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:49.444457    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:07:50.110241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.110206    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"]
Jul 07 15:07:50.110575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.110562    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a31c32-8a15-4d62-a753-e73a90d73379" containerName="console"
Jul 07 15:07:50.110626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.110577    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a31c32-8a15-4d62-a753-e73a90d73379" containerName="console"
Jul 07 15:07:50.110664 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.110657    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a31c32-8a15-4d62-a753-e73a90d73379" containerName="console"
Jul 07 15:07:50.115360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.115344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.118801 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.118784    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zs2b\""
Jul 07 15:07:50.119035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.119021    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:07:50.120096 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.120079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:07:50.138168 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.138141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"]
Jul 07 15:07:50.210700 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.210667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.210700 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.210707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwb65\" (UniqueName: \"kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.210911 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.210762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.311248 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.311209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.311408 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.311270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.311408 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.311290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwb65\" (UniqueName: \"kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.311711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.311688    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.311754 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.311705    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.319947 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.319917    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwb65\" (UniqueName: \"kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.423742 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.423714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:07:50.553918 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.553860    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"]
Jul 07 15:07:50.556675 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:07:50.556648    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafae0438_58a8_4384_a6ee_6ba771daf6c2.slice/crio-36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0 WatchSource:0}: Error finding container 36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0: Status 404 returned error can't find the container with id 36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0
Jul 07 15:07:50.826374 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:50.826291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr" event={"ID":"afae0438-58a8-4384-a6ee-6ba771daf6c2","Type":"ContainerStarted","Data":"36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0"}
Jul 07 15:07:58.863264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:58.863175    2583 generic.go:356] "Generic (PLEG): container finished" podID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerID="917828faffbfbf59c407a4ab8706cb640c58012874bc3979118914b5927b7609" exitCode=0
Jul 07 15:07:58.863623 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:07:58.863263    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr" event={"ID":"afae0438-58a8-4384-a6ee-6ba771daf6c2","Type":"ContainerDied","Data":"917828faffbfbf59c407a4ab8706cb640c58012874bc3979118914b5927b7609"}
Jul 07 15:08:01.878758 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:01.878726    2583 generic.go:356] "Generic (PLEG): container finished" podID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerID="8c4ca26c61469f22f992f0b03f646ab67cbf44f178980a2a7f40d9481c9c2755" exitCode=0
Jul 07 15:08:01.879127 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:01.878814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr" event={"ID":"afae0438-58a8-4384-a6ee-6ba771daf6c2","Type":"ContainerDied","Data":"8c4ca26c61469f22f992f0b03f646ab67cbf44f178980a2a7f40d9481c9c2755"}
Jul 07 15:08:10.917953 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:10.917916    2583 generic.go:356] "Generic (PLEG): container finished" podID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerID="84e0d90c73c5da9a2cda991a9ccd53c4465c0ac70ac4819ce615cbb2eb3ce658" exitCode=0
Jul 07 15:08:10.918316 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:10.917980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr" event={"ID":"afae0438-58a8-4384-a6ee-6ba771daf6c2","Type":"ContainerDied","Data":"84e0d90c73c5da9a2cda991a9ccd53c4465c0ac70ac4819ce615cbb2eb3ce658"}
Jul 07 15:08:12.055226 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.055200    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:08:12.170148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.170111    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwb65\" (UniqueName: \"kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65\") pod \"afae0438-58a8-4384-a6ee-6ba771daf6c2\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") "
Jul 07 15:08:12.170320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.170179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util\") pod \"afae0438-58a8-4384-a6ee-6ba771daf6c2\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") "
Jul 07 15:08:12.170320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.170221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle\") pod \"afae0438-58a8-4384-a6ee-6ba771daf6c2\" (UID: \"afae0438-58a8-4384-a6ee-6ba771daf6c2\") "
Jul 07 15:08:12.171061 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.171034    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle" (OuterVolumeSpecName: "bundle") pod "afae0438-58a8-4384-a6ee-6ba771daf6c2" (UID: "afae0438-58a8-4384-a6ee-6ba771daf6c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:12.172422 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.172358    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65" (OuterVolumeSpecName: "kube-api-access-fwb65") pod "afae0438-58a8-4384-a6ee-6ba771daf6c2" (UID: "afae0438-58a8-4384-a6ee-6ba771daf6c2"). InnerVolumeSpecName "kube-api-access-fwb65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:08:12.174422 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.174395    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util" (OuterVolumeSpecName: "util") pod "afae0438-58a8-4384-a6ee-6ba771daf6c2" (UID: "afae0438-58a8-4384-a6ee-6ba771daf6c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:12.271619 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.271581    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwb65\" (UniqueName: \"kubernetes.io/projected/afae0438-58a8-4384-a6ee-6ba771daf6c2-kube-api-access-fwb65\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:12.271619 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.271610    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:12.271619 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.271619    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afae0438-58a8-4384-a6ee-6ba771daf6c2-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:12.926641 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.926612    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr"
Jul 07 15:08:12.926810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.926611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409fjdr" event={"ID":"afae0438-58a8-4384-a6ee-6ba771daf6c2","Type":"ContainerDied","Data":"36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0"}
Jul 07 15:08:12.926810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:12.926734    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36828926e910ced5303434fdd6980ef0fc666434f85b37026ae521a30f013dd0"
Jul 07 15:08:16.139794 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:16.139758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:16.959136 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:16.959093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:18.121750 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.121713    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"]
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122013    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="util"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122024    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="util"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122035    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="extract"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122041    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="extract"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122048    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="pull"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122053    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="pull"
Jul 07 15:08:18.122115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.122117    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="afae0438-58a8-4384-a6ee-6ba771daf6c2" containerName="extract"
Jul 07 15:08:18.152201 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.152174    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"]
Jul 07 15:08:18.152342 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.152281    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.155210 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.155184    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 15:08:18.155343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.155241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:08:18.155343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.155281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zh79z\""
Jul 07 15:08:18.221069 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.221035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpt5z\" (UniqueName: \"kubernetes.io/projected/e16daa5c-849c-47a8-8858-e4373acc4f9f-kube-api-access-dpt5z\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.221247 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.221103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e16daa5c-849c-47a8-8858-e4373acc4f9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.321717 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.321673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpt5z\" (UniqueName: \"kubernetes.io/projected/e16daa5c-849c-47a8-8858-e4373acc4f9f-kube-api-access-dpt5z\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.321884 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.321812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e16daa5c-849c-47a8-8858-e4373acc4f9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.322179 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.322159    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e16daa5c-849c-47a8-8858-e4373acc4f9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.332617 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.332589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpt5z\" (UniqueName: \"kubernetes.io/projected/e16daa5c-849c-47a8-8858-e4373acc4f9f-kube-api-access-dpt5z\") pod \"cert-manager-operator-controller-manager-55c444bf86-sqs27\" (UID: \"e16daa5c-849c-47a8-8858-e4373acc4f9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.461882 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.461854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"
Jul 07 15:08:18.613100 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.613045    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27"]
Jul 07 15:08:18.616021 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:18.615995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16daa5c_849c_47a8_8858_e4373acc4f9f.slice/crio-eaf8633ab35da80887eedec588516d7747b880a8cd3d92f3bb16bc5539ab6744 WatchSource:0}: Error finding container eaf8633ab35da80887eedec588516d7747b880a8cd3d92f3bb16bc5539ab6744: Status 404 returned error can't find the container with id eaf8633ab35da80887eedec588516d7747b880a8cd3d92f3bb16bc5539ab6744
Jul 07 15:08:18.950995 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:18.950954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27" event={"ID":"e16daa5c-849c-47a8-8858-e4373acc4f9f","Type":"ContainerStarted","Data":"eaf8633ab35da80887eedec588516d7747b880a8cd3d92f3bb16bc5539ab6744"}
Jul 07 15:08:19.714220 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:19.714177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:19.814583 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:19.814527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:20.963491 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:20.962790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27" event={"ID":"e16daa5c-849c-47a8-8858-e4373acc4f9f","Type":"ContainerStarted","Data":"c7cb7cbf2313446b758fa7d5362faa50b62c82b1b351d7802320ab275305c020"}
Jul 07 15:08:20.986519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:20.986467    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sqs27" podStartSLOduration=1.247124493 podStartE2EDuration="2.986453103s" totalImagesPullingTime="1.73932861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:20.984845198 +0000 UTC m=+458.250590174" watchObservedRunningTime="2026-07-07 15:08:20.986453103 +0000 UTC m=+458.252198079"
Jul 07 15:08:21.182533 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.182500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:21.289135 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.289021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:21.329647 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.329613    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7xgh4"]
Jul 07 15:08:21.332031 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.332016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.335266 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.335244    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 15:08:21.335266 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.335247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bmlv9\""
Jul 07 15:08:21.335526 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.335510    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 15:08:21.349030 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.349006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7xgh4"]
Jul 07 15:08:21.416940 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.416904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:21.450009 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.449971    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.450234 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.450019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ldbl\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-kube-api-access-6ldbl\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.522168 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.522132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:21.550979 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.550901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.550979 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.550946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ldbl\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-kube-api-access-6ldbl\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.572921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.572896    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ldbl\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-kube-api-access-6ldbl\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.573077 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.572989    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b2814f7-d3a3-4e10-9fae-3000a7a6c225-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7xgh4\" (UID: \"8b2814f7-d3a3-4e10-9fae-3000a7a6c225\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.650285 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.650247    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:21.790155 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.790035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7xgh4"]
Jul 07 15:08:21.792316 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:21.792288    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b2814f7_d3a3_4e10_9fae_3000a7a6c225.slice/crio-25fa716e497c95e773968ef4db90162c91a81b5d5d24aa202f3581f407051102 WatchSource:0}: Error finding container 25fa716e497c95e773968ef4db90162c91a81b5d5d24aa202f3581f407051102: Status 404 returned error can't find the container with id 25fa716e497c95e773968ef4db90162c91a81b5d5d24aa202f3581f407051102
Jul 07 15:08:21.968809 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:21.968772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4" event={"ID":"8b2814f7-d3a3-4e10-9fae-3000a7a6c225","Type":"ContainerStarted","Data":"25fa716e497c95e773968ef4db90162c91a81b5d5d24aa202f3581f407051102"}
Jul 07 15:08:22.140043 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.140009    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"]
Jul 07 15:08:22.142952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.142936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.146023 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.146002    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zs2b\""
Jul 07 15:08:22.146117 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.146051    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:08:22.147292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.147277    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:08:22.153279 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.153258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"]
Jul 07 15:08:22.257885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.257791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.257885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.257853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.258123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.257885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz5lx\" (UniqueName: \"kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.359125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.359078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.359322 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.359136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.359322 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.359163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz5lx\" (UniqueName: \"kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.359616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.359595    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.359697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.359617    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.369125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.369092    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz5lx\" (UniqueName: \"kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.452656 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.452617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:22.605655 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.605624    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"]
Jul 07 15:08:22.608329 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:22.608292    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e69a9d_ba6c_42e0_9f9d_07e9c5b3be74.slice/crio-03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb WatchSource:0}: Error finding container 03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb: Status 404 returned error can't find the container with id 03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb
Jul 07 15:08:22.975961 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.975928    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerID="db95498b585545bcd3319e619b255f1fee662ef63f8d4b48161c540a43751481" exitCode=0
Jul 07 15:08:22.976416 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.976011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm" event={"ID":"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74","Type":"ContainerDied","Data":"db95498b585545bcd3319e619b255f1fee662ef63f8d4b48161c540a43751481"}
Jul 07 15:08:22.976416 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:22.976062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm" event={"ID":"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74","Type":"ContainerStarted","Data":"03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb"}
Jul 07 15:08:23.544934 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:23.544893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:23.762944 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:23.762871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:24.714410 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.714373    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"]
Jul 07 15:08:24.716891 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.716869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.719779 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.719741    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tvgf6\""
Jul 07 15:08:24.724999 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.724972    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"]
Jul 07 15:08:24.781733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.781696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8bt\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-kube-api-access-wc8bt\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.781920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.781774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.882685 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.882648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.882867 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.882726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8bt\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-kube-api-access-wc8bt\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.893377 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.893343    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8bt\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-kube-api-access-wc8bt\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.893507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.893423    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bee0adb-40f6-42aa-91f3-144f592bee1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-glw7f\" (UID: \"2bee0adb-40f6-42aa-91f3-144f592bee1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:24.988385 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.988300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4" event={"ID":"8b2814f7-d3a3-4e10-9fae-3000a7a6c225","Type":"ContainerStarted","Data":"952b8b778f9ed0241750f972ee9f95dbb48fff3474be1e912228cd7482602628"}
Jul 07 15:08:24.988564 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:24.988422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:25.007224 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.007161    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4" podStartSLOduration=1.675179481 podStartE2EDuration="4.007142408s" totalImagesPullingTime="2.331962927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:25.006592227 +0000 UTC m=+462.272337203" watchObservedRunningTime="2026-07-07 15:08:25.007142408 +0000 UTC m=+462.272887383"
Jul 07 15:08:25.028767 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.028732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"
Jul 07 15:08:25.713137 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.713056    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-glw7f"]
Jul 07 15:08:25.715897 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:25.715862    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bee0adb_40f6_42aa_91f3_144f592bee1d.slice/crio-9880ff9e210fc9989041d4324523adedddb3e44edf0fb1b84f99fe48b2f805a5 WatchSource:0}: Error finding container 9880ff9e210fc9989041d4324523adedddb3e44edf0fb1b84f99fe48b2f805a5: Status 404 returned error can't find the container with id 9880ff9e210fc9989041d4324523adedddb3e44edf0fb1b84f99fe48b2f805a5
Jul 07 15:08:25.994716 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.994682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f" event={"ID":"2bee0adb-40f6-42aa-91f3-144f592bee1d","Type":"ContainerStarted","Data":"fa2bf489d2e7f488eb35d7e8669d4307e67687577b5f883b23b33878eb94877d"}
Jul 07 15:08:25.994716 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.994724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f" event={"ID":"2bee0adb-40f6-42aa-91f3-144f592bee1d","Type":"ContainerStarted","Data":"9880ff9e210fc9989041d4324523adedddb3e44edf0fb1b84f99fe48b2f805a5"}
Jul 07 15:08:25.996613 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.996584    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerID="ddc1e23c84b487de05d4821ca51c06d6b6af7b805134a93e6a5e4fad823e2997" exitCode=0
Jul 07 15:08:25.996767 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:25.996658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm" event={"ID":"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74","Type":"ContainerDied","Data":"ddc1e23c84b487de05d4821ca51c06d6b6af7b805134a93e6a5e4fad823e2997"}
Jul 07 15:08:26.010880 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:26.010827    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-glw7f" podStartSLOduration=2.010807646 podStartE2EDuration="2.010807646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:26.009924009 +0000 UTC m=+463.275668986" watchObservedRunningTime="2026-07-07 15:08:26.010807646 +0000 UTC m=+463.276552623"
Jul 07 15:08:26.500405 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:26.500370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:26.601772 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:26.601733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:27.003235 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:27.003204    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerID="38c280d0fd5f11aa7541eec44a6027d3d36664ac7b9abc3fab212d1016bfcf20" exitCode=0
Jul 07 15:08:27.003624 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:27.003279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm" event={"ID":"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74","Type":"ContainerDied","Data":"38c280d0fd5f11aa7541eec44a6027d3d36664ac7b9abc3fab212d1016bfcf20"}
Jul 07 15:08:28.135093 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.135071    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:28.209609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.209573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util\") pod \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") "
Jul 07 15:08:28.209609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.209609    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz5lx\" (UniqueName: \"kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx\") pod \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") "
Jul 07 15:08:28.209849 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.209647    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle\") pod \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\" (UID: \"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74\") "
Jul 07 15:08:28.210060 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.210036    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle" (OuterVolumeSpecName: "bundle") pod "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" (UID: "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:28.211694 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.211673    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx" (OuterVolumeSpecName: "kube-api-access-qz5lx") pod "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" (UID: "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74"). InnerVolumeSpecName "kube-api-access-qz5lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:08:28.276451 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.276364    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util" (OuterVolumeSpecName: "util") pod "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" (UID: "d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:28.310352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.310317    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:28.310352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.310346    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz5lx\" (UniqueName: \"kubernetes.io/projected/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-kube-api-access-qz5lx\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:28.310352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:28.310357    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:29.013349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:29.013323    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm"
Jul 07 15:08:29.013521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:29.013325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjb8zm" event={"ID":"d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74","Type":"ContainerDied","Data":"03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb"}
Jul 07 15:08:29.013521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:29.013438    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f8b47447231e8ab3c6d9dd70c26bc3cbbf18917fe8d753d3f6e6e51bd0b8fb"
Jul 07 15:08:30.999431 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:30.999404    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7xgh4"
Jul 07 15:08:31.222694 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:31.222656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:33.987635 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:33.987594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:34.102969 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:34.102931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:35.993114 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993075    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"]
Jul 07 15:08:35.993600 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993558    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="util"
Jul 07 15:08:35.993600 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993576    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="util"
Jul 07 15:08:35.993733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993604    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="pull"
Jul 07 15:08:35.993733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993613    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="pull"
Jul 07 15:08:35.993733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993626    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="extract"
Jul 07 15:08:35.993733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993635    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="extract"
Jul 07 15:08:35.993733 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.993720    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e69a9d-ba6c-42e0-9f9d-07e9c5b3be74" containerName="extract"
Jul 07 15:08:35.995760 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.995741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:35.998629 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.998610    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 15:08:35.999796 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.999780    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:08:35.999897 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:35.999818    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-z578g\""
Jul 07 15:08:36.005154 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.005134    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"]
Jul 07 15:08:36.076795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.076761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9ffde52-4550-4089-8a2c-a11122f4ce8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.076795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.076793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqh9r\" (UniqueName: \"kubernetes.io/projected/d9ffde52-4550-4089-8a2c-a11122f4ce8c-kube-api-access-vqh9r\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.178217 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.178181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9ffde52-4550-4089-8a2c-a11122f4ce8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.178217 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.178218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqh9r\" (UniqueName: \"kubernetes.io/projected/d9ffde52-4550-4089-8a2c-a11122f4ce8c-kube-api-access-vqh9r\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.178633 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.178613    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9ffde52-4550-4089-8a2c-a11122f4ce8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.186699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.186680    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqh9r\" (UniqueName: \"kubernetes.io/projected/d9ffde52-4550-4089-8a2c-a11122f4ce8c-kube-api-access-vqh9r\") pod \"openshift-lws-operator-fd8ccff4c-7ngmg\" (UID: \"d9ffde52-4550-4089-8a2c-a11122f4ce8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.304898 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.304815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"
Jul 07 15:08:36.431563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:36.431506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg"]
Jul 07 15:08:36.434601 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:36.434575    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9ffde52_4550_4089_8a2c_a11122f4ce8c.slice/crio-04b01c4b90303b618506e1ff2aa74f58a0d0a510299759aa5c45d95397dff9b8 WatchSource:0}: Error finding container 04b01c4b90303b618506e1ff2aa74f58a0d0a510299759aa5c45d95397dff9b8: Status 404 returned error can't find the container with id 04b01c4b90303b618506e1ff2aa74f58a0d0a510299759aa5c45d95397dff9b8
Jul 07 15:08:37.050591 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:37.050554    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg" event={"ID":"d9ffde52-4550-4089-8a2c-a11122f4ce8c","Type":"ContainerStarted","Data":"04b01c4b90303b618506e1ff2aa74f58a0d0a510299759aa5c45d95397dff9b8"}
Jul 07 15:08:39.061921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:39.061879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg" event={"ID":"d9ffde52-4550-4089-8a2c-a11122f4ce8c","Type":"ContainerStarted","Data":"b03ffbaf1728e6dce86b17ed5d9a277fcd2b5de8491ecd9708289a8ded4d8109"}
Jul 07 15:08:39.080711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:39.080650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7ngmg" podStartSLOduration=2.234692584 podStartE2EDuration="4.08062835s" totalImagesPullingTime="1.845935766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:39.078442722 +0000 UTC m=+476.344187696" watchObservedRunningTime="2026-07-07 15:08:39.08062835 +0000 UTC m=+476.346373326"
Jul 07 15:08:39.843192 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:39.843150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:39.943511 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:39.943472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:41.517617 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.517580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:41.614500 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.614458    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"]
Jul 07 15:08:41.632037 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.632012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"]
Jul 07 15:08:41.632208 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.632113    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.634807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.634778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zs2b\""
Jul 07 15:08:41.634927 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.634827    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:08:41.636161 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.636142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:08:41.725082 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.725036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.725250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.725124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.725250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.725182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjhjb\" (UniqueName: \"kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.826422 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.826329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.826422 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.826375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjhjb\" (UniqueName: \"kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.826422 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.826424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.826769 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.826748    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.826815 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.826801    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.835099 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.835075    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjhjb\" (UniqueName: \"kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:41.942195 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:41.942136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:42.073604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:42.073572    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"]
Jul 07 15:08:42.075295 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:42.075269    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf2ca90_9c93_41d1_a915_5a6fc85d7631.slice/crio-f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58 WatchSource:0}: Error finding container f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58: Status 404 returned error can't find the container with id f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58
Jul 07 15:08:43.080784 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:43.080743    2583 generic.go:356] "Generic (PLEG): container finished" podID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerID="1a1de91fe4d64b1efcf12df2d0368a543374641778047c782ed64db04602589c" exitCode=0
Jul 07 15:08:43.081191 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:43.080782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7" event={"ID":"6cf2ca90-9c93-41d1-a915-5a6fc85d7631","Type":"ContainerDied","Data":"1a1de91fe4d64b1efcf12df2d0368a543374641778047c782ed64db04602589c"}
Jul 07 15:08:43.081191 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:43.080832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7" event={"ID":"6cf2ca90-9c93-41d1-a915-5a6fc85d7631","Type":"ContainerStarted","Data":"f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58"}
Jul 07 15:08:44.087362 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:44.087330    2583 generic.go:356] "Generic (PLEG): container finished" podID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerID="e45b26e7c78471afe9f4eeb950c52b9ff87a386cebaebfb7df1140f52e9d1899" exitCode=0
Jul 07 15:08:44.087861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:44.087396    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7" event={"ID":"6cf2ca90-9c93-41d1-a915-5a6fc85d7631","Type":"ContainerDied","Data":"e45b26e7c78471afe9f4eeb950c52b9ff87a386cebaebfb7df1140f52e9d1899"}
Jul 07 15:08:45.093951 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:45.093921    2583 generic.go:356] "Generic (PLEG): container finished" podID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerID="00d7e9883e392bd77fecf1e4c1d7447707e76a85c5e0ec6377b2324d8ebaa479" exitCode=0
Jul 07 15:08:45.094331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:45.093983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7" event={"ID":"6cf2ca90-9c93-41d1-a915-5a6fc85d7631","Type":"ContainerDied","Data":"00d7e9883e392bd77fecf1e4c1d7447707e76a85c5e0ec6377b2324d8ebaa479"}
Jul 07 15:08:46.220686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.220662    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:46.360463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.360361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util\") pod \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") "
Jul 07 15:08:46.360463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.360424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle\") pod \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") "
Jul 07 15:08:46.360463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.360457    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjhjb\" (UniqueName: \"kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb\") pod \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\" (UID: \"6cf2ca90-9c93-41d1-a915-5a6fc85d7631\") "
Jul 07 15:08:46.361291 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.361265    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle" (OuterVolumeSpecName: "bundle") pod "6cf2ca90-9c93-41d1-a915-5a6fc85d7631" (UID: "6cf2ca90-9c93-41d1-a915-5a6fc85d7631"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:46.362630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.362604    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb" (OuterVolumeSpecName: "kube-api-access-cjhjb") pod "6cf2ca90-9c93-41d1-a915-5a6fc85d7631" (UID: "6cf2ca90-9c93-41d1-a915-5a6fc85d7631"). InnerVolumeSpecName "kube-api-access-cjhjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:08:46.368557 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.368512    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util" (OuterVolumeSpecName: "util") pod "6cf2ca90-9c93-41d1-a915-5a6fc85d7631" (UID: "6cf2ca90-9c93-41d1-a915-5a6fc85d7631"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:08:46.461663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.461624    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:46.461663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.461657    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:46.461663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:46.461666    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjhjb\" (UniqueName: \"kubernetes.io/projected/6cf2ca90-9c93-41d1-a915-5a6fc85d7631-kube-api-access-cjhjb\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:08:47.104701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:47.104669    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7"
Jul 07 15:08:47.104868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:47.104668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsmwr7" event={"ID":"6cf2ca90-9c93-41d1-a915-5a6fc85d7631","Type":"ContainerDied","Data":"f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58"}
Jul 07 15:08:47.104868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:47.104789    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f97182845d8092fcc8ccc87ccede48950527799620b6db50084dcefc5fbb9f58"
Jul 07 15:08:47.707476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:47.707444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:48.953220 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:48.953190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:49.003154 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:49.003117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:53.565115 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:53.565081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:53.673609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:53.673577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.176573 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.176513    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.383271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.383236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.488753 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.488658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.538258 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538228    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"]
Jul 07 15:08:54.538563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538534    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="extract"
Jul 07 15:08:54.538612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538565    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="extract"
Jul 07 15:08:54.538612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538578    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="util"
Jul 07 15:08:54.538612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538583    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="util"
Jul 07 15:08:54.538612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538590    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="pull"
Jul 07 15:08:54.538612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538596    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="pull"
Jul 07 15:08:54.538776 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.538661    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf2ca90-9c93-41d1-a915-5a6fc85d7631" containerName="extract"
Jul 07 15:08:54.541282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.541265    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.544074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.544054    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:08:54.544211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.544139    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:08:54.544300 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.544235    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f2t5w\""
Jul 07 15:08:54.544574 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.544558    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:08:54.544665 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.544647    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:08:54.560146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.560118    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"]
Jul 07 15:08:54.630731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.630696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj47j\" (UniqueName: \"kubernetes.io/projected/d335a360-aad1-41f2-918e-aa1b4c52ac96-kube-api-access-mj47j\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.630731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.630737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.631148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.630774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.631148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.630809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.631148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.630839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.653298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.653266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.732188 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.732366 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.732366 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.732459 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj47j\" (UniqueName: \"kubernetes.io/projected/d335a360-aad1-41f2-918e-aa1b4c52ac96-kube-api-access-mj47j\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.732512 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.732652 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.732624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.734782 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.734745    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d335a360-aad1-41f2-918e-aa1b4c52ac96-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.734901 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.734860    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.734966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.734920    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d335a360-aad1-41f2-918e-aa1b4c52ac96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.757268 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.757197    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj47j\" (UniqueName: \"kubernetes.io/projected/d335a360-aad1-41f2-918e-aa1b4c52ac96-kube-api-access-mj47j\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-78lrl\" (UID: \"d335a360-aad1-41f2-918e-aa1b4c52ac96\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.767013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.766980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.852464 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.852426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:08:54.865044 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.864991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.969351 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.969316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:54.992098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:54.992071    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"]
Jul 07 15:08:54.993001 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:08:54.992979    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd335a360_aad1_41f2_918e_aa1b4c52ac96.slice/crio-0dd06a0c291581864b3894e2d8def49d511aaa0bd361184302a4cef93b7235f6 WatchSource:0}: Error finding container 0dd06a0c291581864b3894e2d8def49d511aaa0bd361184302a4cef93b7235f6: Status 404 returned error can't find the container with id 0dd06a0c291581864b3894e2d8def49d511aaa0bd361184302a4cef93b7235f6
Jul 07 15:08:55.064827 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:55.064732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:55.142613 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:55.142576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl" event={"ID":"d335a360-aad1-41f2-918e-aa1b4c52ac96","Type":"ContainerStarted","Data":"0dd06a0c291581864b3894e2d8def49d511aaa0bd361184302a4cef93b7235f6"}
Jul 07 15:08:59.170988 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:59.170939    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl" event={"ID":"d335a360-aad1-41f2-918e-aa1b4c52ac96","Type":"ContainerStarted","Data":"fd61301bbfa888951e828a0477a4d2176a17a5e6bf05baf507732121266bc8a6"}
Jul 07 15:08:59.764550 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:59.764508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:08:59.870086 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:08:59.870050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:00.177351 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:00.177317    2583 generic.go:356] "Generic (PLEG): container finished" podID="d335a360-aad1-41f2-918e-aa1b4c52ac96" containerID="fd61301bbfa888951e828a0477a4d2176a17a5e6bf05baf507732121266bc8a6" exitCode=0
Jul 07 15:09:00.177748 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:00.177408    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl" event={"ID":"d335a360-aad1-41f2-918e-aa1b4c52ac96","Type":"ContainerDied","Data":"fd61301bbfa888951e828a0477a4d2176a17a5e6bf05baf507732121266bc8a6"}
Jul 07 15:09:01.183767 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:01.183736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl" event={"ID":"d335a360-aad1-41f2-918e-aa1b4c52ac96","Type":"ContainerStarted","Data":"c57f5b2805377421ade16809e0eb55f886f5dad7def011a0d6b35dbd25b462b5"}
Jul 07 15:09:01.184160 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:01.183837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:09:01.209410 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:01.209355    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl" podStartSLOduration=2.408883845 podStartE2EDuration="7.209340137s" totalImagesPullingTime="3.78476271s" totalInitContainerRuntime="1.015693582s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:01.208721588 +0000 UTC m=+498.474466604" watchObservedRunningTime="2026-07-07 15:09:01.209340137 +0000 UTC m=+498.475085111"
Jul 07 15:09:12.191078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:12.191048    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-78lrl"
Jul 07 15:09:13.780931 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:13.780896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:13.899661 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:13.899620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:14.544807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.544768    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"]
Jul 07 15:09:14.547152 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.547134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.550223 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.550198    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 15:09:14.551477 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.551459    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 15:09:14.551616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.551525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l26bg\""
Jul 07 15:09:14.551616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.551525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 15:09:14.569249 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.569216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"]
Jul 07 15:09:14.602467 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.602441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-metrics-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.602637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.602486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5wp\" (UniqueName: \"kubernetes.io/projected/1dd09e42-ee5d-42f7-a7a2-f36456fec396-kube-api-access-8z5wp\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.602637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.602571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.602637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.602615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1dd09e42-ee5d-42f7-a7a2-f36456fec396-manager-config\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.659373 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.659334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:14.704025 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.703995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.704192 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.704036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1dd09e42-ee5d-42f7-a7a2-f36456fec396-manager-config\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.704192 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.704067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-metrics-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.704192 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.704104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5wp\" (UniqueName: \"kubernetes.io/projected/1dd09e42-ee5d-42f7-a7a2-f36456fec396-kube-api-access-8z5wp\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.704977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.704948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1dd09e42-ee5d-42f7-a7a2-f36456fec396-manager-config\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.706442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.706422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.706651 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.706631    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dd09e42-ee5d-42f7-a7a2-f36456fec396-metrics-cert\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.717237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.717195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5wp\" (UniqueName: \"kubernetes.io/projected/1dd09e42-ee5d-42f7-a7a2-f36456fec396-kube-api-access-8z5wp\") pod \"lws-controller-manager-55947775b5-v8wvs\" (UID: \"1dd09e42-ee5d-42f7-a7a2-f36456fec396\") " pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.732194 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.732156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:14.857433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.857335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:14.993498 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:14.993471    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"]
Jul 07 15:09:14.995481 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:09:14.995460    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd09e42_ee5d_42f7_a7a2_f36456fec396.slice/crio-f6018821660a048adcf8260e59c583a756c242711bbc1bb7a7460be27a257b32 WatchSource:0}: Error finding container f6018821660a048adcf8260e59c583a756c242711bbc1bb7a7460be27a257b32: Status 404 returned error can't find the container with id f6018821660a048adcf8260e59c583a756c242711bbc1bb7a7460be27a257b32
Jul 07 15:09:15.113307 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:15.113222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:15.253982 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:15.253937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs" event={"ID":"1dd09e42-ee5d-42f7-a7a2-f36456fec396","Type":"ContainerStarted","Data":"f6018821660a048adcf8260e59c583a756c242711bbc1bb7a7460be27a257b32"}
Jul 07 15:09:15.274698 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:15.274663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:15.459038 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:15.459000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:17.266987 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:17.266952    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs" event={"ID":"1dd09e42-ee5d-42f7-a7a2-f36456fec396","Type":"ContainerStarted","Data":"3443391532aaf02469133b7a679c6eedfb001dbe20626b3e9b7eeb57fc1f0475"}
Jul 07 15:09:17.267455 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:17.267035    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:17.287796 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:17.287744    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs" podStartSLOduration=1.7872618679999999 podStartE2EDuration="3.287729249s" totalImagesPullingTime="1.500467381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:17.284710915 +0000 UTC m=+514.550455891" watchObservedRunningTime="2026-07-07 15:09:17.287729249 +0000 UTC m=+514.553474223"
Jul 07 15:09:19.775756 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.775705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:19.830902 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.830870    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"]
Jul 07 15:09:19.833726 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.833703    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:19.838162 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.838142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:09:19.838289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.838142    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 15:09:19.838289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.838149    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-442xg\""
Jul 07 15:09:19.838289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.838173    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 15:09:19.838289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.838173    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:09:19.845789 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.845769    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"]
Jul 07 15:09:19.864779 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.864733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:19.947063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.947026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tmp\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:19.947261 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.947094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44zj\" (UniqueName: \"kubernetes.io/projected/8e0e6e00-68ab-4279-b0a5-852c46cb351f-kube-api-access-z44zj\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:19.947261 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:19.947125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.048113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.048022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z44zj\" (UniqueName: \"kubernetes.io/projected/8e0e6e00-68ab-4279-b0a5-852c46cb351f-kube-api-access-z44zj\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.048113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.048065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.048361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.048144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tmp\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.050518 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.050487    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tmp\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.050819 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.050797    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0e6e00-68ab-4279-b0a5-852c46cb351f-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.058979 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.058955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44zj\" (UniqueName: \"kubernetes.io/projected/8e0e6e00-68ab-4279-b0a5-852c46cb351f-kube-api-access-z44zj\") pod \"kube-auth-proxy-f474c7cd5-f9nml\" (UID: \"8e0e6e00-68ab-4279-b0a5-852c46cb351f\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.144025 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.143987    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"
Jul 07 15:09:20.285715 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.285689    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml"]
Jul 07 15:09:20.287041 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:09:20.287019    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0e6e00_68ab_4279_b0a5_852c46cb351f.slice/crio-d1e0cc8c28d3d32cd5e0a48fdeea0d41c430549d7af8e17a4416ab5d79dd6445 WatchSource:0}: Error finding container d1e0cc8c28d3d32cd5e0a48fdeea0d41c430549d7af8e17a4416ab5d79dd6445: Status 404 returned error can't find the container with id d1e0cc8c28d3d32cd5e0a48fdeea0d41c430549d7af8e17a4416ab5d79dd6445
Jul 07 15:09:20.931510 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.931474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:20.997442 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:20.997397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:21.288711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:21.288622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml" event={"ID":"8e0e6e00-68ab-4279-b0a5-852c46cb351f","Type":"ContainerStarted","Data":"d1e0cc8c28d3d32cd5e0a48fdeea0d41c430549d7af8e17a4416ab5d79dd6445"}
Jul 07 15:09:22.164986 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:22.164949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:24.306846 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:24.306804    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml" event={"ID":"8e0e6e00-68ab-4279-b0a5-852c46cb351f","Type":"ContainerStarted","Data":"e09705b475715c0e820542465ffbfe4c1c8d8e592b93fba5b3c96f45fbaf07c2"}
Jul 07 15:09:24.355562 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:24.355491    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-f9nml" podStartSLOduration=2.089890789 podStartE2EDuration="5.355475931s" totalImagesPullingTime="3.265585142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:24.350808969 +0000 UTC m=+521.616553948" watchObservedRunningTime="2026-07-07 15:09:24.355475931 +0000 UTC m=+521.621220906"
Jul 07 15:09:25.215315 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:25.215279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:25.371310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:25.371276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:25.502107 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:25.502014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:25.622002 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:25.621952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:26.355123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:26.355091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:26.651094 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:26.651004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:26.764092 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:26.764045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:27.396135 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:27.396100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:27.665630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:27.665516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:28.274830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:28.274800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55947775b5-v8wvs"
Jul 07 15:09:37.502220 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:37.502129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:37.601997 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:37.601964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:39.300385 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:39.300347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:57.930682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:57.930643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:09:59.130336 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:09:59.130291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:15.369590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:15.369526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:15.475810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:15.475777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:15.634951 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:15.634859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:30.694905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.694872    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"]
Jul 07 15:10:30.698833 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.698802    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.701605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.701584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:10:30.701724 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.701646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p75tw\""
Jul 07 15:10:30.701724 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.701684    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:10:30.709343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.709298    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"]
Jul 07 15:10:30.762144 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.762108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.762318 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.762160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.762318 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.762180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk459\" (UniqueName: \"kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.862705 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.862665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.862907 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.862719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.862907 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.862838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk459\" (UniqueName: \"kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.863135 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.863111    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.863197 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.863123    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:30.871835 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:30.871812    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk459\" (UniqueName: \"kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:31.010968 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.010880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:31.146003 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.145978    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"]
Jul 07 15:10:31.149150 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:10:31.149119    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861763d6_a2d1_4bfb_9e1d_41c28e6a8e11.slice/crio-1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8 WatchSource:0}: Error finding container 1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8: Status 404 returned error can't find the container with id 1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8
Jul 07 15:10:31.494360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.494323    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"]
Jul 07 15:10:31.497922 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.497905    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.507643 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.507621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"]
Jul 07 15:10:31.569529 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.569434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.569529 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.569501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdnw\" (UniqueName: \"kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.569740 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.569582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.620620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.620584    2583 generic.go:356] "Generic (PLEG): container finished" podID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerID="5af37dd21a822768f6cb9888db997566cab5e68ac2dfc93f12ef8b6e605c81f8" exitCode=0
Jul 07 15:10:31.620780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.620650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk" event={"ID":"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11","Type":"ContainerDied","Data":"5af37dd21a822768f6cb9888db997566cab5e68ac2dfc93f12ef8b6e605c81f8"}
Jul 07 15:10:31.620780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.620699    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk" event={"ID":"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11","Type":"ContainerStarted","Data":"1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8"}
Jul 07 15:10:31.670642 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.670605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.670823 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.670651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.670823 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.670702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdnw\" (UniqueName: \"kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.670999 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.670977    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.671089 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.671072    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.679116 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.679086    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdnw\" (UniqueName: \"kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.807975 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.807935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:31.894466 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.894412    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"]
Jul 07 15:10:31.898532 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.898508    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:31.906238 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.906201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"]
Jul 07 15:10:31.946465 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.946442    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"]
Jul 07 15:10:31.948587 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:10:31.948559    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fea01e_bfcc_45e7_b055_c26302bee23d.slice/crio-2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa WatchSource:0}: Error finding container 2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa: Status 404 returned error can't find the container with id 2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa
Jul 07 15:10:31.974463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.974431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhdc\" (UniqueName: \"kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:31.974609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.974499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:31.974609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:31.974530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.075781 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.075748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhdc\" (UniqueName: \"kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.075917 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.075792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.075917 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.075811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.076123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.076105    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.076162 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.076151    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.088436 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.088412    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhdc\" (UniqueName: \"kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.209780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.209749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:32.298612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.298583    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"]
Jul 07 15:10:32.302765 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.302738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.309903 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.309177    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"]
Jul 07 15:10:32.358209 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.358180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"]
Jul 07 15:10:32.377968 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.377938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbvq\" (UniqueName: \"kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.378103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.377974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.378103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.377999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.382777 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:10:32.382751    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd986cf4_cd01_4d09_95e9_1c1ffb20c680.slice/crio-3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34 WatchSource:0}: Error finding container 3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34: Status 404 returned error can't find the container with id 3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34
Jul 07 15:10:32.479423 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.479394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.479596 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.479440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.479738 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.479593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbvq\" (UniqueName: \"kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.479828 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.479805    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.479958 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.479920    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.489304 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.489279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbvq\" (UniqueName: \"kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.618213 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.618173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:32.626847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.626817    2583 generic.go:356] "Generic (PLEG): container finished" podID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerID="2c2c8c0fd40f050eec6740ece08f26f3ca87b9d448e49c31a0a381fcbcb1d874" exitCode=0
Jul 07 15:10:32.626981 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.626868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk" event={"ID":"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11","Type":"ContainerDied","Data":"2c2c8c0fd40f050eec6740ece08f26f3ca87b9d448e49c31a0a381fcbcb1d874"}
Jul 07 15:10:32.628612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.628591    2583 generic.go:356] "Generic (PLEG): container finished" podID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerID="849856e0358333e8338f5ed67165042bb00d23b93cce2912116d80ec21e20a93" exitCode=0
Jul 07 15:10:32.628696 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.628666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l" event={"ID":"56fea01e-bfcc-45e7-b055-c26302bee23d","Type":"ContainerDied","Data":"849856e0358333e8338f5ed67165042bb00d23b93cce2912116d80ec21e20a93"}
Jul 07 15:10:32.628758 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.628704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l" event={"ID":"56fea01e-bfcc-45e7-b055-c26302bee23d","Type":"ContainerStarted","Data":"2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa"}
Jul 07 15:10:32.630351 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.630314    2583 generic.go:356] "Generic (PLEG): container finished" podID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerID="891f586087a34ff2bec838222cba81158750b805b45862bef7d118d7394d8af8" exitCode=0
Jul 07 15:10:32.630351 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.630352    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk" event={"ID":"dd986cf4-cd01-4d09-95e9-1c1ffb20c680","Type":"ContainerDied","Data":"891f586087a34ff2bec838222cba81158750b805b45862bef7d118d7394d8af8"}
Jul 07 15:10:32.630525 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.630385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk" event={"ID":"dd986cf4-cd01-4d09-95e9-1c1ffb20c680","Type":"ContainerStarted","Data":"3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34"}
Jul 07 15:10:32.768466 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:32.768443    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"]
Jul 07 15:10:32.826367 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:10:32.826331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ec6ce4_f476_4594_ab61_57c273d16e8c.slice/crio-c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b WatchSource:0}: Error finding container c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b: Status 404 returned error can't find the container with id c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b
Jul 07 15:10:33.638241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.638144    2583 generic.go:356] "Generic (PLEG): container finished" podID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerID="79160380314b48f2d0f235d5dd9baeb2aa57dacee6ef76133650a87e0b9b74ce" exitCode=0
Jul 07 15:10:33.638241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.638228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l" event={"ID":"56fea01e-bfcc-45e7-b055-c26302bee23d","Type":"ContainerDied","Data":"79160380314b48f2d0f235d5dd9baeb2aa57dacee6ef76133650a87e0b9b74ce"}
Jul 07 15:10:33.639858 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.639801    2583 generic.go:356] "Generic (PLEG): container finished" podID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerID="c46d5af30955b1671ef34adb72d2aaadc3e932642c433c8ccc564cd3449cedae" exitCode=0
Jul 07 15:10:33.639934 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.639882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj" event={"ID":"f4ec6ce4-f476-4594-ab61-57c273d16e8c","Type":"ContainerDied","Data":"c46d5af30955b1671ef34adb72d2aaadc3e932642c433c8ccc564cd3449cedae"}
Jul 07 15:10:33.639934 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.639924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj" event={"ID":"f4ec6ce4-f476-4594-ab61-57c273d16e8c","Type":"ContainerStarted","Data":"c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b"}
Jul 07 15:10:33.642299 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.642274    2583 generic.go:356] "Generic (PLEG): container finished" podID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerID="0855d7d5d26f10009c9e0d09a45705296ca144ed42cbccef2e2fff99ce12e6c5" exitCode=0
Jul 07 15:10:33.642396 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:33.642335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk" event={"ID":"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11","Type":"ContainerDied","Data":"0855d7d5d26f10009c9e0d09a45705296ca144ed42cbccef2e2fff99ce12e6c5"}
Jul 07 15:10:34.649951 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.649917    2583 generic.go:356] "Generic (PLEG): container finished" podID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerID="9a5821213d921922ebda5498b2f0e71951c56544781779c3cd7238591e64d3ad" exitCode=0
Jul 07 15:10:34.650415 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.650012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l" event={"ID":"56fea01e-bfcc-45e7-b055-c26302bee23d","Type":"ContainerDied","Data":"9a5821213d921922ebda5498b2f0e71951c56544781779c3cd7238591e64d3ad"}
Jul 07 15:10:34.651706 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.651683    2583 generic.go:356] "Generic (PLEG): container finished" podID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerID="39862e9692cfd1fea3c056219ca01cc9183b8f21678e5b9f84a0c2328fa9400a" exitCode=0
Jul 07 15:10:34.651832 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.651810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk" event={"ID":"dd986cf4-cd01-4d09-95e9-1c1ffb20c680","Type":"ContainerDied","Data":"39862e9692cfd1fea3c056219ca01cc9183b8f21678e5b9f84a0c2328fa9400a"}
Jul 07 15:10:34.778085 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.778059    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:34.899159 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.899130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util\") pod \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") "
Jul 07 15:10:34.899328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.899270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk459\" (UniqueName: \"kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459\") pod \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") "
Jul 07 15:10:34.899328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.899290    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle\") pod \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\" (UID: \"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11\") "
Jul 07 15:10:34.899880 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.899848    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle" (OuterVolumeSpecName: "bundle") pod "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" (UID: "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:34.901533 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.901484    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459" (OuterVolumeSpecName: "kube-api-access-xk459") pod "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" (UID: "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11"). InnerVolumeSpecName "kube-api-access-xk459". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:10:34.904180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:34.904147    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util" (OuterVolumeSpecName: "util") pod "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" (UID: "861763d6-a2d1-4bfb-9e1d-41c28e6a8e11"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:35.000218 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.000183    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk459\" (UniqueName: \"kubernetes.io/projected/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-kube-api-access-xk459\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:35.000218 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.000211    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:35.000218 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.000221    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/861763d6-a2d1-4bfb-9e1d-41c28e6a8e11-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:35.658175 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.658087    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk"
Jul 07 15:10:35.658175 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.658091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk" event={"ID":"861763d6-a2d1-4bfb-9e1d-41c28e6a8e11","Type":"ContainerDied","Data":"1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8"}
Jul 07 15:10:35.658702 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.658179    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b1aa9965fb3f141eb646ff03777f005aae6f06c4b50d531a6cd44494256cdf8"
Jul 07 15:10:35.660203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.660176    2583 generic.go:356] "Generic (PLEG): container finished" podID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerID="5c73beca5911258ee1415a0cea5ce104cafa69c3a26de86be3d6894333be7a11" exitCode=0
Jul 07 15:10:35.660325 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.660229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk" event={"ID":"dd986cf4-cd01-4d09-95e9-1c1ffb20c680","Type":"ContainerDied","Data":"5c73beca5911258ee1415a0cea5ce104cafa69c3a26de86be3d6894333be7a11"}
Jul 07 15:10:35.662174 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.662150    2583 generic.go:356] "Generic (PLEG): container finished" podID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerID="6db20b7d26b7e6626bf89f458b348200d29751e26b228e6b7dfecdd644d27c30" exitCode=0
Jul 07 15:10:35.662275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.662218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj" event={"ID":"f4ec6ce4-f476-4594-ab61-57c273d16e8c","Type":"ContainerDied","Data":"6db20b7d26b7e6626bf89f458b348200d29751e26b228e6b7dfecdd644d27c30"}
Jul 07 15:10:35.797355 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.797331    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:35.907880 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.907851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqdnw\" (UniqueName: \"kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw\") pod \"56fea01e-bfcc-45e7-b055-c26302bee23d\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") "
Jul 07 15:10:35.908051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.907899    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle\") pod \"56fea01e-bfcc-45e7-b055-c26302bee23d\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") "
Jul 07 15:10:35.908051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.907971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util\") pod \"56fea01e-bfcc-45e7-b055-c26302bee23d\" (UID: \"56fea01e-bfcc-45e7-b055-c26302bee23d\") "
Jul 07 15:10:35.908628 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.908561    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle" (OuterVolumeSpecName: "bundle") pod "56fea01e-bfcc-45e7-b055-c26302bee23d" (UID: "56fea01e-bfcc-45e7-b055-c26302bee23d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:35.910100 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.910076    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw" (OuterVolumeSpecName: "kube-api-access-dqdnw") pod "56fea01e-bfcc-45e7-b055-c26302bee23d" (UID: "56fea01e-bfcc-45e7-b055-c26302bee23d"). InnerVolumeSpecName "kube-api-access-dqdnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:10:35.913406 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:35.913369    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util" (OuterVolumeSpecName: "util") pod "56fea01e-bfcc-45e7-b055-c26302bee23d" (UID: "56fea01e-bfcc-45e7-b055-c26302bee23d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:36.009504 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.009468    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqdnw\" (UniqueName: \"kubernetes.io/projected/56fea01e-bfcc-45e7-b055-c26302bee23d-kube-api-access-dqdnw\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:36.009504 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.009497    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:36.009504 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.009507    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56fea01e-bfcc-45e7-b055-c26302bee23d-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:36.669352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.669314    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l"
Jul 07 15:10:36.669352 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.669322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l" event={"ID":"56fea01e-bfcc-45e7-b055-c26302bee23d","Type":"ContainerDied","Data":"2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa"}
Jul 07 15:10:36.669866 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.669368    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bbc38b65a8b0fb17ea3fac36f536983323f1641cf64eecd57af04c8bfcaa6aa"
Jul 07 15:10:36.671447 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.671416    2583 generic.go:356] "Generic (PLEG): container finished" podID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerID="a901657d941c662701c3e199d5b023e617f0934e503f9ebf6977b38ce5c847c0" exitCode=0
Jul 07 15:10:36.671586 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.671552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj" event={"ID":"f4ec6ce4-f476-4594-ab61-57c273d16e8c","Type":"ContainerDied","Data":"a901657d941c662701c3e199d5b023e617f0934e503f9ebf6977b38ce5c847c0"}
Jul 07 15:10:36.800873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.800847    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:36.916807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.916775    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util\") pod \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") "
Jul 07 15:10:36.916968 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.916821    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle\") pod \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") "
Jul 07 15:10:36.916968 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.916875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvhdc\" (UniqueName: \"kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc\") pod \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\" (UID: \"dd986cf4-cd01-4d09-95e9-1c1ffb20c680\") "
Jul 07 15:10:36.917348 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.917323    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle" (OuterVolumeSpecName: "bundle") pod "dd986cf4-cd01-4d09-95e9-1c1ffb20c680" (UID: "dd986cf4-cd01-4d09-95e9-1c1ffb20c680"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:36.919094 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.919069    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc" (OuterVolumeSpecName: "kube-api-access-wvhdc") pod "dd986cf4-cd01-4d09-95e9-1c1ffb20c680" (UID: "dd986cf4-cd01-4d09-95e9-1c1ffb20c680"). InnerVolumeSpecName "kube-api-access-wvhdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:10:36.922377 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:36.922333    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util" (OuterVolumeSpecName: "util") pod "dd986cf4-cd01-4d09-95e9-1c1ffb20c680" (UID: "dd986cf4-cd01-4d09-95e9-1c1ffb20c680"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:37.018098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.018061    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:37.018098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.018091    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:37.018098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.018100    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvhdc\" (UniqueName: \"kubernetes.io/projected/dd986cf4-cd01-4d09-95e9-1c1ffb20c680-kube-api-access-wvhdc\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:37.679341 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.679308    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk"
Jul 07 15:10:37.679341 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.679334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk" event={"ID":"dd986cf4-cd01-4d09-95e9-1c1ffb20c680","Type":"ContainerDied","Data":"3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34"}
Jul 07 15:10:37.679765 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.679377    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ec37ec9ebbd8cfa31accf2b8f0fa3f0431196d9be34a9bfbb1cfbb7e8218c34"
Jul 07 15:10:37.814031 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.814004    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:37.925140 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.925108    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwbvq\" (UniqueName: \"kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq\") pod \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") "
Jul 07 15:10:37.925340 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.925210    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle\") pod \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") "
Jul 07 15:10:37.925340 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.925234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util\") pod \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\" (UID: \"f4ec6ce4-f476-4594-ab61-57c273d16e8c\") "
Jul 07 15:10:37.925832 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.925806    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle" (OuterVolumeSpecName: "bundle") pod "f4ec6ce4-f476-4594-ab61-57c273d16e8c" (UID: "f4ec6ce4-f476-4594-ab61-57c273d16e8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:37.927346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.927325    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq" (OuterVolumeSpecName: "kube-api-access-lwbvq") pod "f4ec6ce4-f476-4594-ab61-57c273d16e8c" (UID: "f4ec6ce4-f476-4594-ab61-57c273d16e8c"). InnerVolumeSpecName "kube-api-access-lwbvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:10:37.930591 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:37.930531    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util" (OuterVolumeSpecName: "util") pod "f4ec6ce4-f476-4594-ab61-57c273d16e8c" (UID: "f4ec6ce4-f476-4594-ab61-57c273d16e8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:10:38.026492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.026452    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:38.026492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.026485    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ec6ce4-f476-4594-ab61-57c273d16e8c-util\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:38.026492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.026497    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwbvq\" (UniqueName: \"kubernetes.io/projected/f4ec6ce4-f476-4594-ab61-57c273d16e8c-kube-api-access-lwbvq\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:10:38.282195 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.282119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:38.334375 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.334341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:38.688640 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.688611    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj"
Jul 07 15:10:38.689034 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.688637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj" event={"ID":"f4ec6ce4-f476-4594-ab61-57c273d16e8c","Type":"ContainerDied","Data":"c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b"}
Jul 07 15:10:38.689034 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:38.688683    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c480a43e7deed45004572fc2353c5eefc36cc105423dec1f51ca6e44222d917b"
Jul 07 15:10:44.253468 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:44.253427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:46.311163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:46.311128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:48.448243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:48.448209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:50.853310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:50.853272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:51.097335 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:51.097303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:51.450560 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:51.450516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:54.858891 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:54.858862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:55.897000 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:55.896957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:55.999006 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:55.998970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:57.986973 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:57.986935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:10:59.689766 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:10:59.689723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:01.086807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:01.086777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:01.157776 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:01.157735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:04.861720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:04.861612    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:04.960964 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:04.960925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:06.584397 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:06.584361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:09.047279 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:09.047239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:09.119833 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:09.119799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:09.566076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:09.566038    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:09.668514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:09.668476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:10.771919 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.771890    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"]
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772224    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772234    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772244    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772249    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772258    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772264    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772273    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772278    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772284    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772289    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772296    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772300    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772305    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772311    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772317    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772322    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="extract"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772332    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772337    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772344    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772349    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="pull"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772356    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772360    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772368    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="util"
Jul 07 15:11:10.772359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772373    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="util"
Jul 07 15:11:10.773063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772426    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd986cf4-cd01-4d09-95e9-1c1ffb20c680" containerName="extract"
Jul 07 15:11:10.773063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772435    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="861763d6-a2d1-4bfb-9e1d-41c28e6a8e11" containerName="extract"
Jul 07 15:11:10.773063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772444    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fea01e-bfcc-45e7-b055-c26302bee23d" containerName="extract"
Jul 07 15:11:10.773063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.772449    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ec6ce4-f476-4594-ab61-57c273d16e8c" containerName="extract"
Jul 07 15:11:10.775525 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.775509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.778334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.778310    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 15:11:10.779570 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.779525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 15:11:10.779570 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.779550    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:11:10.779761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.779531    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p75tw\""
Jul 07 15:11:10.779761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.779530    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:11:10.785445 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.785424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"]
Jul 07 15:11:10.797871 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.797846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln562\" (UniqueName: \"kubernetes.io/projected/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-kube-api-access-ln562\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.797991 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.797898    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.798034 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.797979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.802463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.802432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:10.899112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.899077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.899364 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.899134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln562\" (UniqueName: \"kubernetes.io/projected/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-kube-api-access-ln562\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.899364 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.899176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.899364 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:11:10.899268    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 15:11:10.899364 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:11:10.899333    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert podName:11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b nodeName:}" failed. No retries permitted until 2026-07-07 15:11:11.399317131 +0000 UTC m=+628.665062083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pggz7" (UID: "11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b") : secret "plugin-serving-cert" not found
Jul 07 15:11:10.899841 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.899819    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.907794 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.907764    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln562\" (UniqueName: \"kubernetes.io/projected/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-kube-api-access-ln562\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:10.982338 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:10.982301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:11.403798 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:11.403743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:11.406237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:11.406204    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pggz7\" (UID: \"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:11.686334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:11.686298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"
Jul 07 15:11:11.823136 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:11.823107    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7"]
Jul 07 15:11:11.826162 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:11:11.826135    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11ab4bd1_bf02_41d6_87ce_d5e5b6760b8b.slice/crio-a969601b151a054a8c0aab6f01f51a3ecdca24cf8806f75a654cc3fd0c310f6e WatchSource:0}: Error finding container a969601b151a054a8c0aab6f01f51a3ecdca24cf8806f75a654cc3fd0c310f6e: Status 404 returned error can't find the container with id a969601b151a054a8c0aab6f01f51a3ecdca24cf8806f75a654cc3fd0c310f6e
Jul 07 15:11:11.866076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:11.866041    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7" event={"ID":"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b","Type":"ContainerStarted","Data":"a969601b151a054a8c0aab6f01f51a3ecdca24cf8806f75a654cc3fd0c310f6e"}
Jul 07 15:11:13.249621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:13.249582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:13.347938 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:13.347902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:19.791994 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:19.791960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:19.892708 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:19.892648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:22.620520 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:22.620485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:22.724502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:22.724462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:27.412923 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:27.412846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:27.513679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:27.513607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:31.007750 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:31.007702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:31.107845 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:31.107798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:37.022138 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:37.022107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7" event={"ID":"11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b","Type":"ContainerStarted","Data":"70f057389670b2a6475051e14d43d4e3bf5d3c5f260b475b3331648f80ff5f79"}
Jul 07 15:11:37.038637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:37.038587    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pggz7" podStartSLOduration=1.912377261 podStartE2EDuration="27.038570597s" totalImagesPullingTime="25.126193336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:37.03830647 +0000 UTC m=+654.304051460" watchObservedRunningTime="2026-07-07 15:11:37.038570597 +0000 UTC m=+654.304315569"
Jul 07 15:11:37.594842 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:37.594808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:37.699476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:37.699440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:40.804090 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:40.804050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:40.902949 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:40.902915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:44.264241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:44.264203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:44.363331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:44.363297    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:45.393433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:45.393398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:45.561065 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:45.561029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:45.687530 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:45.687498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:46.479244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:46.479208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:50.594772 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:50.594731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:50.660030 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:50.659999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:50.807855 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:50.807812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:11:51.220390 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:11:51.220357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:07.785888 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:07.785853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:07.881374 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:07.881338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:07.946772 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:07.946699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:08.083181 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.083097    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:12:08.085661 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.085643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.088360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.088340    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 15:12:08.094517 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.094496    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:12:08.117145 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.117104    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:12:08.213240 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.213207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-config-file\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.213419 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.213263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf5rs\" (UniqueName: \"kubernetes.io/projected/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-kube-api-access-gf5rs\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.314525 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.314485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-config-file\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.314743 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.314576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5rs\" (UniqueName: \"kubernetes.io/projected/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-kube-api-access-gf5rs\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.315125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.315105    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-config-file\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.322990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.322958    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5rs\" (UniqueName: \"kubernetes.io/projected/20f99bbd-56fe-4fcd-88e2-4d79f955fbf9-kube-api-access-gf5rs\") pod \"limitador-limitador-54d6d988d5-srsbk\" (UID: \"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.397388 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.397288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:08.531261 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.531233    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:12:08.533378 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:12:08.533346    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f99bbd_56fe_4fcd_88e2_4d79f955fbf9.slice/crio-b6e6413457f5eb1ff9e95bbb8a06d5ec227f2df871ec8720351ebaf779cc6610 WatchSource:0}: Error finding container b6e6413457f5eb1ff9e95bbb8a06d5ec227f2df871ec8720351ebaf779cc6610: Status 404 returned error can't find the container with id b6e6413457f5eb1ff9e95bbb8a06d5ec227f2df871ec8720351ebaf779cc6610
Jul 07 15:12:08.535327 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.535304    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:12:08.611416 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.611363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:08.689143 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.689099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:08.693692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.693667    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:08.696929 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.696913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:08.699808 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.699787    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qk84r\""
Jul 07 15:12:08.704469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.704444    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:08.819810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.819756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlmr\" (UniqueName: \"kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr\") pod \"authorino-75d556bd77-vgw85\" (UID: \"18869157-3322-4572-bd33-468a84dc0b26\") " pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:08.920408 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.920368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlmr\" (UniqueName: \"kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr\") pod \"authorino-75d556bd77-vgw85\" (UID: \"18869157-3322-4572-bd33-468a84dc0b26\") " pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:08.929443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:08.929414    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlmr\" (UniqueName: \"kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr\") pod \"authorino-75d556bd77-vgw85\" (UID: \"18869157-3322-4572-bd33-468a84dc0b26\") " pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:09.007497 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:09.007413    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:09.177912 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:09.177883    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:09.182383 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:12:09.182341    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18869157_3322_4572_bd33_468a84dc0b26.slice/crio-90510e56aef2f641dc59e77a28c338ccd5b0997851ef2ece400e71049bec2cf4 WatchSource:0}: Error finding container 90510e56aef2f641dc59e77a28c338ccd5b0997851ef2ece400e71049bec2cf4: Status 404 returned error can't find the container with id 90510e56aef2f641dc59e77a28c338ccd5b0997851ef2ece400e71049bec2cf4
Jul 07 15:12:09.201487 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:09.201424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vgw85" event={"ID":"18869157-3322-4572-bd33-468a84dc0b26","Type":"ContainerStarted","Data":"90510e56aef2f641dc59e77a28c338ccd5b0997851ef2ece400e71049bec2cf4"}
Jul 07 15:12:09.203488 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:09.203417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk" event={"ID":"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9","Type":"ContainerStarted","Data":"b6e6413457f5eb1ff9e95bbb8a06d5ec227f2df871ec8720351ebaf779cc6610"}
Jul 07 15:12:10.458563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:10.458507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:12.223849 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:12.223816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk" event={"ID":"20f99bbd-56fe-4fcd-88e2-4d79f955fbf9","Type":"ContainerStarted","Data":"9760e6d78d4a3c1ca8ff752d75d2b3a9a9e2d933dccc86b446b48cca641c4345"}
Jul 07 15:12:12.224235 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:12.224054    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:12.240783 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:12.240730    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk" podStartSLOduration=1.57071572 podStartE2EDuration="4.240713503s" totalImagesPullingTime="2.669997783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:12.239794204 +0000 UTC m=+689.505539179" watchObservedRunningTime="2026-07-07 15:12:12.240713503 +0000 UTC m=+689.506458477"
Jul 07 15:12:13.239296 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:13.239258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vgw85" event={"ID":"18869157-3322-4572-bd33-468a84dc0b26","Type":"ContainerStarted","Data":"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"}
Jul 07 15:12:13.255942 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:13.255865    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vgw85" podStartSLOduration=1.323901023 podStartE2EDuration="5.255849549s" totalImagesPullingTime="3.931948526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:13.255218064 +0000 UTC m=+690.520963054" watchObservedRunningTime="2026-07-07 15:12:13.255849549 +0000 UTC m=+690.521594552"
Jul 07 15:12:23.241204 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:23.241168    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-srsbk"
Jul 07 15:12:29.625444 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:29.625411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:41.957188 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:41.957086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:42.206364 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.206331    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:42.209920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.209868    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:42.215799 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.215769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2l9h\" (UniqueName: \"kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h\") pod \"authorino-5d4b67c446-w4sfm\" (UID: \"1251ca07-eafb-43b7-a7b6-644f0623449f\") " pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:42.218178 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.218152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:42.316955 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.316916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2l9h\" (UniqueName: \"kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h\") pod \"authorino-5d4b67c446-w4sfm\" (UID: \"1251ca07-eafb-43b7-a7b6-644f0623449f\") " pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:42.325562 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.325521    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2l9h\" (UniqueName: \"kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h\") pod \"authorino-5d4b67c446-w4sfm\" (UID: \"1251ca07-eafb-43b7-a7b6-644f0623449f\") " pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:42.469688 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.469602    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:42.469869 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.469856    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:42.500282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.500246    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:42.503807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.503789    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:42.512052 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.512023    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:42.518911 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.518885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxxc\" (UniqueName: \"kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc\") pod \"authorino-56b6b4498-nvqd6\" (UID: \"5c5a3643-5068-4ae3-95c0-2598296bf8bc\") " pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:42.541323 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.541292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:42.616214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.616190    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:42.617818 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:12:42.617787    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1251ca07_eafb_43b7_a7b6_644f0623449f.slice/crio-fce0f4457140ae6d9cdd5f7da5dc131cc65e29be4b898d8169aef693939d0b26 WatchSource:0}: Error finding container fce0f4457140ae6d9cdd5f7da5dc131cc65e29be4b898d8169aef693939d0b26: Status 404 returned error can't find the container with id fce0f4457140ae6d9cdd5f7da5dc131cc65e29be4b898d8169aef693939d0b26
Jul 07 15:12:42.619434 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.619382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxxc\" (UniqueName: \"kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc\") pod \"authorino-56b6b4498-nvqd6\" (UID: \"5c5a3643-5068-4ae3-95c0-2598296bf8bc\") " pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:42.627872 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.627847    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxxc\" (UniqueName: \"kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc\") pod \"authorino-56b6b4498-nvqd6\" (UID: \"5c5a3643-5068-4ae3-95c0-2598296bf8bc\") " pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:42.766592 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.766481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:42.766814 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.766795    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:42.794251 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.794219    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:12:42.797966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.797944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.800848 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.800830    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 15:12:42.805797 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.805713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:12:42.821102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.821076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnxz\" (UniqueName: \"kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.821231 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.821212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.903185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.903156    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:42.904608 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:12:42.904582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c5a3643_5068_4ae3_95c0_2598296bf8bc.slice/crio-2e94fcebdcc3bb01a5e9d78cf7437cea809a12fd00d65a5d717f6a18624f4afa WatchSource:0}: Error finding container 2e94fcebdcc3bb01a5e9d78cf7437cea809a12fd00d65a5d717f6a18624f4afa: Status 404 returned error can't find the container with id 2e94fcebdcc3bb01a5e9d78cf7437cea809a12fd00d65a5d717f6a18624f4afa
Jul 07 15:12:42.922163 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.922137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.922283 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.922218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnxz\" (UniqueName: \"kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.924521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.924497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:42.931366 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:42.931345    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnxz\" (UniqueName: \"kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz\") pod \"authorino-7d6446cdb-7xfnx\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") " pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:43.111370 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.111327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:12:43.244751 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.244727    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:12:43.246161 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:12:43.246129    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13bcb5eb_517f_454b_b207_fa7093a93460.slice/crio-3eeb0871ddc2435b1b98f321f80bceb6b03514cbcb50b0b51c217ae60b4c159c WatchSource:0}: Error finding container 3eeb0871ddc2435b1b98f321f80bceb6b03514cbcb50b0b51c217ae60b4c159c: Status 404 returned error can't find the container with id 3eeb0871ddc2435b1b98f321f80bceb6b03514cbcb50b0b51c217ae60b4c159c
Jul 07 15:12:43.404603 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.404568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" event={"ID":"13bcb5eb-517f-454b-b207-fa7093a93460","Type":"ContainerStarted","Data":"3eeb0871ddc2435b1b98f321f80bceb6b03514cbcb50b0b51c217ae60b4c159c"}
Jul 07 15:12:43.405595 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.405573    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b6b4498-nvqd6" event={"ID":"5c5a3643-5068-4ae3-95c0-2598296bf8bc","Type":"ContainerStarted","Data":"2e94fcebdcc3bb01a5e9d78cf7437cea809a12fd00d65a5d717f6a18624f4afa"}
Jul 07 15:12:43.406943 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.406921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" event={"ID":"1251ca07-eafb-43b7-a7b6-644f0623449f","Type":"ContainerStarted","Data":"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"}
Jul 07 15:12:43.407046 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.406955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" event={"ID":"1251ca07-eafb-43b7-a7b6-644f0623449f","Type":"ContainerStarted","Data":"fce0f4457140ae6d9cdd5f7da5dc131cc65e29be4b898d8169aef693939d0b26"}
Jul 07 15:12:43.407046 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.406991    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" podUID="1251ca07-eafb-43b7-a7b6-644f0623449f" containerName="authorino" containerID="cri-o://e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add" gracePeriod=30
Jul 07 15:12:43.422433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.422392    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" podStartSLOduration=1.069254579 podStartE2EDuration="1.422371391s" totalImagesPullingTime="353.116812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:43.421516797 +0000 UTC m=+720.687261774" watchObservedRunningTime="2026-07-07 15:12:43.422371391 +0000 UTC m=+720.688116374"
Jul 07 15:12:43.667607 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.667577    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:43.728682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.728660    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2l9h\" (UniqueName: \"kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h\") pod \"1251ca07-eafb-43b7-a7b6-644f0623449f\" (UID: \"1251ca07-eafb-43b7-a7b6-644f0623449f\") "
Jul 07 15:12:43.730351 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.730325    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h" (OuterVolumeSpecName: "kube-api-access-l2l9h") pod "1251ca07-eafb-43b7-a7b6-644f0623449f" (UID: "1251ca07-eafb-43b7-a7b6-644f0623449f"). InnerVolumeSpecName "kube-api-access-l2l9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:12:43.829602 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:43.829514    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2l9h\" (UniqueName: \"kubernetes.io/projected/1251ca07-eafb-43b7-a7b6-644f0623449f-kube-api-access-l2l9h\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:12:44.414443 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.414408    2583 generic.go:356] "Generic (PLEG): container finished" podID="1251ca07-eafb-43b7-a7b6-644f0623449f" containerID="e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add" exitCode=0
Jul 07 15:12:44.414905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.414453    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w4sfm"
Jul 07 15:12:44.414905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.414491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" event={"ID":"1251ca07-eafb-43b7-a7b6-644f0623449f","Type":"ContainerDied","Data":"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"}
Jul 07 15:12:44.414905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.414532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w4sfm" event={"ID":"1251ca07-eafb-43b7-a7b6-644f0623449f","Type":"ContainerDied","Data":"fce0f4457140ae6d9cdd5f7da5dc131cc65e29be4b898d8169aef693939d0b26"}
Jul 07 15:12:44.414905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.414566    2583 scope.go:117] "RemoveContainer" containerID="e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"
Jul 07 15:12:44.416310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.416282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" event={"ID":"13bcb5eb-517f-454b-b207-fa7093a93460","Type":"ContainerStarted","Data":"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"}
Jul 07 15:12:44.417929 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.417905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b6b4498-nvqd6" event={"ID":"5c5a3643-5068-4ae3-95c0-2598296bf8bc","Type":"ContainerStarted","Data":"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"}
Jul 07 15:12:44.418035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.417987    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56b6b4498-nvqd6" podUID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" containerName="authorino" containerID="cri-o://04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80" gracePeriod=30
Jul 07 15:12:44.424941 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.424925    2583 scope.go:117] "RemoveContainer" containerID="e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"
Jul 07 15:12:44.425237 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:12:44.425218    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add\": container with ID starting with e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add not found: ID does not exist" containerID="e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"
Jul 07 15:12:44.425282 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.425245    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add"} err="failed to get container status \"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add\": rpc error: code = NotFound desc = could not find container \"e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add\": container with ID starting with e894e3393fadeaeafe1d9f7e0ead7904fc1785405623a20bed142d8f77e28add not found: ID does not exist"
Jul 07 15:12:44.437773 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.437733    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" podStartSLOduration=1.9717587650000001 podStartE2EDuration="2.437719544s" totalImagesPullingTime="465.960779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:44.435342293 +0000 UTC m=+721.701087269" watchObservedRunningTime="2026-07-07 15:12:44.437719544 +0000 UTC m=+721.703464520"
Jul 07 15:12:44.452803 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.452745    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56b6b4498-nvqd6" podStartSLOduration=1.9980790769999999 podStartE2EDuration="2.452728058s" totalImagesPullingTime="454.648981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:44.450246484 +0000 UTC m=+721.715991459" watchObservedRunningTime="2026-07-07 15:12:44.452728058 +0000 UTC m=+721.718473033"
Jul 07 15:12:44.461095 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.461065    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:44.461269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.461253    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vgw85" podUID="18869157-3322-4572-bd33-468a84dc0b26" containerName="authorino" containerID="cri-o://39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6" gracePeriod=30
Jul 07 15:12:44.467845 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.467819    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:44.478388 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.478357    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w4sfm"]
Jul 07 15:12:44.756595 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.756559    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:44.770386 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.770356    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:44.837630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.837593    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxxc\" (UniqueName: \"kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc\") pod \"5c5a3643-5068-4ae3-95c0-2598296bf8bc\" (UID: \"5c5a3643-5068-4ae3-95c0-2598296bf8bc\") "
Jul 07 15:12:44.837873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.837682    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtlmr\" (UniqueName: \"kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr\") pod \"18869157-3322-4572-bd33-468a84dc0b26\" (UID: \"18869157-3322-4572-bd33-468a84dc0b26\") "
Jul 07 15:12:44.839725 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.839696    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc" (OuterVolumeSpecName: "kube-api-access-2qxxc") pod "5c5a3643-5068-4ae3-95c0-2598296bf8bc" (UID: "5c5a3643-5068-4ae3-95c0-2598296bf8bc"). InnerVolumeSpecName "kube-api-access-2qxxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:12:44.839814 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.839724    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr" (OuterVolumeSpecName: "kube-api-access-xtlmr") pod "18869157-3322-4572-bd33-468a84dc0b26" (UID: "18869157-3322-4572-bd33-468a84dc0b26"). InnerVolumeSpecName "kube-api-access-xtlmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:12:44.938334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.938294    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtlmr\" (UniqueName: \"kubernetes.io/projected/18869157-3322-4572-bd33-468a84dc0b26-kube-api-access-xtlmr\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:12:44.938334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:44.938327    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxxc\" (UniqueName: \"kubernetes.io/projected/5c5a3643-5068-4ae3-95c0-2598296bf8bc-kube-api-access-2qxxc\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:12:45.284534 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.284458    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1251ca07-eafb-43b7-a7b6-644f0623449f" path="/var/lib/kubelet/pods/1251ca07-eafb-43b7-a7b6-644f0623449f/volumes"
Jul 07 15:12:45.425331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.425294    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" containerID="04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80" exitCode=0
Jul 07 15:12:45.425798 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.425342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56b6b4498-nvqd6"
Jul 07 15:12:45.425798 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.425383    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b6b4498-nvqd6" event={"ID":"5c5a3643-5068-4ae3-95c0-2598296bf8bc","Type":"ContainerDied","Data":"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"}
Jul 07 15:12:45.425798 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.425427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56b6b4498-nvqd6" event={"ID":"5c5a3643-5068-4ae3-95c0-2598296bf8bc","Type":"ContainerDied","Data":"2e94fcebdcc3bb01a5e9d78cf7437cea809a12fd00d65a5d717f6a18624f4afa"}
Jul 07 15:12:45.425798 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.425449    2583 scope.go:117] "RemoveContainer" containerID="04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"
Jul 07 15:12:45.426851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.426813    2583 generic.go:356] "Generic (PLEG): container finished" podID="18869157-3322-4572-bd33-468a84dc0b26" containerID="39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6" exitCode=0
Jul 07 15:12:45.426958 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.426869    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vgw85"
Jul 07 15:12:45.426958 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.426907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vgw85" event={"ID":"18869157-3322-4572-bd33-468a84dc0b26","Type":"ContainerDied","Data":"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"}
Jul 07 15:12:45.427084 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.426964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vgw85" event={"ID":"18869157-3322-4572-bd33-468a84dc0b26","Type":"ContainerDied","Data":"90510e56aef2f641dc59e77a28c338ccd5b0997851ef2ece400e71049bec2cf4"}
Jul 07 15:12:45.434501 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.434483    2583 scope.go:117] "RemoveContainer" containerID="04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"
Jul 07 15:12:45.434801 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:12:45.434783    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80\": container with ID starting with 04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80 not found: ID does not exist" containerID="04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"
Jul 07 15:12:45.434873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.434808    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80"} err="failed to get container status \"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80\": rpc error: code = NotFound desc = could not find container \"04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80\": container with ID starting with 04d04735f05627a884ed6130bd44da678ffa403adbe73aa560e8995d3cc02e80 not found: ID does not exist"
Jul 07 15:12:45.434873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.434824    2583 scope.go:117] "RemoveContainer" containerID="39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"
Jul 07 15:12:45.443146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.443129    2583 scope.go:117] "RemoveContainer" containerID="39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"
Jul 07 15:12:45.443404 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:12:45.443385    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6\": container with ID starting with 39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6 not found: ID does not exist" containerID="39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"
Jul 07 15:12:45.443466 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.443410    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6"} err="failed to get container status \"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6\": rpc error: code = NotFound desc = could not find container \"39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6\": container with ID starting with 39fe705383d5e06eac183168332fa0b9a21b767d41628fe2ad565c43d5167eb6 not found: ID does not exist"
Jul 07 15:12:45.473180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.473149    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:45.496478 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.496443    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56b6b4498-nvqd6"]
Jul 07 15:12:45.528920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.528885    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:45.536456 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:45.536372    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vgw85"]
Jul 07 15:12:47.284469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:47.284437    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18869157-3322-4572-bd33-468a84dc0b26" path="/var/lib/kubelet/pods/18869157-3322-4572-bd33-468a84dc0b26/volumes"
Jul 07 15:12:47.284866 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:47.284795    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" path="/var/lib/kubelet/pods/5c5a3643-5068-4ae3-95c0-2598296bf8bc/volumes"
Jul 07 15:12:49.762826 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:49.762791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:49.857372 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:49.857337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:49.918412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:49.918351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:52.728872 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:52.728835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:12:52.830460 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:12:52.830428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:23.410208 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:23.410143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:23.464281 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:23.464232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:25.299072 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:25.299036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:25.728104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:25.728074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:25.829240 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:25.829205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:26.169205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:26.169171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:26.256021 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:26.255987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:26.361194 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:26.361147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:13:36.966022 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:36.965983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:37.065227 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:37.065186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:49.652659 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:49.652623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:49.832720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:49.832687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:13:58.167335 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:58.167287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:13:58.800293 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:13:58.800247    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:14:27.092459 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:27.092351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:14:28.194264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:28.194224    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:14:43.933480 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:43.933440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:14:45.494496 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:45.494455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:14:57.244331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:57.244296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:14:58.598583 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:14:58.598522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:15:04.899201 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:04.899163    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:15:10.721486 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:10.721450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:15:12.569791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:12.569756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:15:13.398972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:13.398926    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:15:44.278611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:44.278474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:15:44.380143 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:15:44.380097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:03.662696 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:03.662659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:19.320395 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320361    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-548f6c7647-chkt7"]
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320729    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1251ca07-eafb-43b7-a7b6-644f0623449f" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320740    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1251ca07-eafb-43b7-a7b6-644f0623449f" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320758    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320763    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320770    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18869157-3322-4572-bd33-468a84dc0b26" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320775    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18869157-3322-4572-bd33-468a84dc0b26" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320839    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18869157-3322-4572-bd33-468a84dc0b26" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320850    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5a3643-5068-4ae3-95c0-2598296bf8bc" containerName="authorino"
Jul 07 15:16:19.320914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.320856    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1251ca07-eafb-43b7-a7b6-644f0623449f" containerName="authorino"
Jul 07 15:16:19.323768 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.323752    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.330625 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.330598    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548f6c7647-chkt7"]
Jul 07 15:16:19.390778 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.390738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tln\" (UniqueName: \"kubernetes.io/projected/fea04d64-a25d-4f2f-842e-2b6689007df2-kube-api-access-w8tln\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.390778 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.390784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fea04d64-a25d-4f2f-842e-2b6689007df2-tls-cert\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.492086 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.492048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tln\" (UniqueName: \"kubernetes.io/projected/fea04d64-a25d-4f2f-842e-2b6689007df2-kube-api-access-w8tln\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.492252 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.492095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fea04d64-a25d-4f2f-842e-2b6689007df2-tls-cert\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.494508 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.494486    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fea04d64-a25d-4f2f-842e-2b6689007df2-tls-cert\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.500470 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.500443    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tln\" (UniqueName: \"kubernetes.io/projected/fea04d64-a25d-4f2f-842e-2b6689007df2-kube-api-access-w8tln\") pod \"authorino-548f6c7647-chkt7\" (UID: \"fea04d64-a25d-4f2f-842e-2b6689007df2\") " pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.634371 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.634275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548f6c7647-chkt7"
Jul 07 15:16:19.769127 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.769083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:19.776102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.776078    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548f6c7647-chkt7"]
Jul 07 15:16:19.777775 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:16:19.777747    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfea04d64_a25d_4f2f_842e_2b6689007df2.slice/crio-724c9819dbca0cefd8661ac234dd53b607ac70f902eba0b6f92deef15dd3cec2 WatchSource:0}: Error finding container 724c9819dbca0cefd8661ac234dd53b607ac70f902eba0b6f92deef15dd3cec2: Status 404 returned error can't find the container with id 724c9819dbca0cefd8661ac234dd53b607ac70f902eba0b6f92deef15dd3cec2
Jul 07 15:16:19.875063 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:19.875022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:20.566614 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.566575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548f6c7647-chkt7" event={"ID":"fea04d64-a25d-4f2f-842e-2b6689007df2","Type":"ContainerStarted","Data":"6cfac8bbd40893a3e573c0872ef953529a1506a1933f210db749167d7f3b74ef"}
Jul 07 15:16:20.567102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.566624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548f6c7647-chkt7" event={"ID":"fea04d64-a25d-4f2f-842e-2b6689007df2","Type":"ContainerStarted","Data":"724c9819dbca0cefd8661ac234dd53b607ac70f902eba0b6f92deef15dd3cec2"}
Jul 07 15:16:20.586462 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.586407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-548f6c7647-chkt7" podStartSLOduration=0.956425282 podStartE2EDuration="1.586390841s" totalImagesPullingTime="629.965559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:16:20.583491796 +0000 UTC m=+937.849236770" watchObservedRunningTime="2026-07-07 15:16:20.586390841 +0000 UTC m=+937.852135815"
Jul 07 15:16:20.613271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.613238    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:16:20.613446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.613424    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" podUID="13bcb5eb-517f-454b-b207-fa7093a93460" containerName="authorino" containerID="cri-o://f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1" gracePeriod=30
Jul 07 15:16:20.877183 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.877157    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:16:20.904075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.904047    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert\") pod \"13bcb5eb-517f-454b-b207-fa7093a93460\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") "
Jul 07 15:16:20.904299 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.904090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbnxz\" (UniqueName: \"kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz\") pod \"13bcb5eb-517f-454b-b207-fa7093a93460\" (UID: \"13bcb5eb-517f-454b-b207-fa7093a93460\") "
Jul 07 15:16:20.907831 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.907793    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz" (OuterVolumeSpecName: "kube-api-access-xbnxz") pod "13bcb5eb-517f-454b-b207-fa7093a93460" (UID: "13bcb5eb-517f-454b-b207-fa7093a93460"). InnerVolumeSpecName "kube-api-access-xbnxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:16:20.917844 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.917808    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "13bcb5eb-517f-454b-b207-fa7093a93460" (UID: "13bcb5eb-517f-454b-b207-fa7093a93460"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:16:20.995412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:20.995330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:21.005317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.005279    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/13bcb5eb-517f-454b-b207-fa7093a93460-tls-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:16:21.005317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.005303    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbnxz\" (UniqueName: \"kubernetes.io/projected/13bcb5eb-517f-454b-b207-fa7093a93460-kube-api-access-xbnxz\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:16:21.143065 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.143023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:16:21.574243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.574152    2583 generic.go:356] "Generic (PLEG): container finished" podID="13bcb5eb-517f-454b-b207-fa7093a93460" containerID="f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1" exitCode=0
Jul 07 15:16:21.574243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.574190    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6446cdb-7xfnx"
Jul 07 15:16:21.574243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.574226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" event={"ID":"13bcb5eb-517f-454b-b207-fa7093a93460","Type":"ContainerDied","Data":"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"}
Jul 07 15:16:21.574795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.574266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6446cdb-7xfnx" event={"ID":"13bcb5eb-517f-454b-b207-fa7093a93460","Type":"ContainerDied","Data":"3eeb0871ddc2435b1b98f321f80bceb6b03514cbcb50b0b51c217ae60b4c159c"}
Jul 07 15:16:21.574795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.574285    2583 scope.go:117] "RemoveContainer" containerID="f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"
Jul 07 15:16:21.583383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.583364    2583 scope.go:117] "RemoveContainer" containerID="f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"
Jul 07 15:16:21.583717 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:16:21.583697    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1\": container with ID starting with f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1 not found: ID does not exist" containerID="f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"
Jul 07 15:16:21.583788 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.583728    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1"} err="failed to get container status \"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1\": rpc error: code = NotFound desc = could not find container \"f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1\": container with ID starting with f4ced0067ec04deb50a4ea9965bdfc931faad7672e5f10d0443c9a207c3b4eb1 not found: ID does not exist"
Jul 07 15:16:21.594631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.594607    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:16:21.600792 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:21.600769    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d6446cdb-7xfnx"]
Jul 07 15:16:23.284038 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:23.284002    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13bcb5eb-517f-454b-b207-fa7093a93460" path="/var/lib/kubelet/pods/13bcb5eb-517f-454b-b207-fa7093a93460/volumes"
Jul 07 15:16:50.761059 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:50.761016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:16:56.008785 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:16:56.008746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:17:00.898510 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:00.898473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:17:07.394906 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:07.394819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:17:11.396294 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:11.396261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:17:21.196604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:21.196564    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:17:31.997808 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:31.997770    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:17:34.122337 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:34.122293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:17:35.816365 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:17:35.816333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:01.700861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:01.700820    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:18:13.186435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:13.186392    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:18:18.058477 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:18.058422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:18.242529 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:18.242494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:18.436150 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:18.436112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:23.916908 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:23.916869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:23.984476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:23.984430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:24.065006 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:24.064970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:24.313272 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:24.313241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:24.368879 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:24.368841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:29.818730 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:29.818688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:29.918851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:29.918813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:18:47.204907 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:47.204827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:18:56.297519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:18:56.297483    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:04.991476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:04.991441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:13.790734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:13.790691    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:24.698975 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:24.698929    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:34.189804 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:34.189768    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:46.490478 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:46.490441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:19:55.895260 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:19:55.895221    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:20:09.634513 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:20:09.634437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:20:09.723078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:20:09.723041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:20:18.393920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:20:18.393885    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:20:30.898630 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:20:30.898597    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:20:53.398846 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:20:53.398808    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:04.000980 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:04.000944    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:19.406946 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:19.406906    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:28.391906 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:28.391872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:32.561748 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:32.561713    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:21:37.701761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:37.701680    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:46.518904 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:46.518869    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:56.306490 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:56.306455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:21:58.319040 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:21:58.318999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:23:46.799359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:23:46.799319    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:23:58.509532 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:23:58.509494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:24:07.206238 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:07.206180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:24:08.509332 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:08.509300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:24:08.591013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:08.590970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:24:19.864640 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:19.864601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:24:31.798491 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:31.798454    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:24:40.697446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:40.697362    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:24:50.500575 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:24:50.500525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:25:01.094983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:25:01.094941    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:25:12.895015 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:25:12.894972    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:25:21.197126 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:25:21.197066    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:25:31.790475 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:25:31.790436    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:25:38.395091 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:25:38.395055    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:03.292087 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:03.292053    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:10.896976 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:10.896937    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:20.907333 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:20.907292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:30.293450 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:30.293415    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:45.806236 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:45.806183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:26:56.497977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:26:56.497939    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:27:08.296377 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:08.296342    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:27:21.591670 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:21.591633    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:27:28.997558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:28.997501    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:27:38.400598 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:38.400510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:27:43.645896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:43.645841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:27:45.876021 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:45.875980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:27:45.939451 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:45.939423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:27:51.494557 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:27:51.494498    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:00.508075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:00.508034    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:10.995605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:10.995569    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:23.197517 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:23.197483    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:33.593437 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:33.593400    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:43.400730 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:43.400695    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:28:53.807631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:28:53.807590    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:06.793623 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:06.793523    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:18.707735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:18.707700    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:20.490188 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:20.490146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:29.858394 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:29.858354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:32.527106 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:32.527067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:38.150133 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:38.150094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:43.350520 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:43.350485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:46.568432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:46.568386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:46.664765 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:46.664721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:46.713838 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:46.713795    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:47.098910 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:47.098866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:53.127415 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:53.127377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:53.230119 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:53.230088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:53.401946 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:53.401851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:53.499859 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:53.499821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:54.605905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.605871    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:29:54.606398 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.606378    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13bcb5eb-517f-454b-b207-fa7093a93460" containerName="authorino"
Jul 07 15:29:54.606480 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.606402    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="13bcb5eb-517f-454b-b207-fa7093a93460" containerName="authorino"
Jul 07 15:29:54.606568 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.606553    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="13bcb5eb-517f-454b-b207-fa7093a93460" containerName="authorino"
Jul 07 15:29:54.609090 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.609064    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.613717 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.613685    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:29:54.613830 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.613789    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-03188eb0-serving-cert\""
Jul 07 15:29:54.624222 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.624198    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:29:54.649841 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.649810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.649841 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.649843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzmzj\" (UniqueName: \"kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.650046 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.649883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.750697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.750661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.750916 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.750734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.750916 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.750755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzmzj\" (UniqueName: \"kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.751415 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.751391    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.753212 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.753193    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.761156 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.761135    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzmzj\" (UniqueName: \"kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj\") pod \"maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") " pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:54.920510 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:54.920478    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:55.067317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.067278    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:29:55.068448 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:29:55.068422    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555fd11d_0b29_4116_bd0d_9419924f2c19.slice/crio-f16ac13e16eb558830d9a9ef9ee3d5ac1d74a7c99907f5df7dffc41ec3a7c9aa WatchSource:0}: Error finding container f16ac13e16eb558830d9a9ef9ee3d5ac1d74a7c99907f5df7dffc41ec3a7c9aa: Status 404 returned error can't find the container with id f16ac13e16eb558830d9a9ef9ee3d5ac1d74a7c99907f5df7dffc41ec3a7c9aa
Jul 07 15:29:55.069863 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.069839    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:29:55.093188 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.093156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:55.211082 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.210995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:55.363308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.363272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:55.456816 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.456774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:55.915038 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:55.914997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" event={"ID":"555fd11d-0b29-4116-bd0d-9419924f2c19","Type":"ContainerStarted","Data":"f16ac13e16eb558830d9a9ef9ee3d5ac1d74a7c99907f5df7dffc41ec3a7c9aa"}
Jul 07 15:29:57.312328 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:57.312294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:57.928106 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:57.928068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" event={"ID":"555fd11d-0b29-4116-bd0d-9419924f2c19","Type":"ContainerStarted","Data":"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"}
Jul 07 15:29:57.928307 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:57.928170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:29:57.951865 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:57.951814    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" podStartSLOduration=1.262689792 podStartE2EDuration="3.951799756s" totalImagesPullingTime="2.689109964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:57.949236007 +0000 UTC m=+1755.214980985" watchObservedRunningTime="2026-07-07 15:29:57.951799756 +0000 UTC m=+1755.217544731"
Jul 07 15:29:59.725131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:59.725092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:29:59.801919 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:59.801876    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:29:59.924185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:29:59.924144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:00.034580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.034471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:00.090503 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.090472    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:30:00.090709 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.090684    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" podUID="555fd11d-0b29-4116-bd0d-9419924f2c19" containerName="maas-api" containerID="cri-o://5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601" gracePeriod=30
Jul 07 15:30:00.145011 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.144983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:00.339651 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.339627    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:30:00.399597 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.399562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls\") pod \"555fd11d-0b29-4116-bd0d-9419924f2c19\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") "
Jul 07 15:30:00.399597 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.399597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzmzj\" (UniqueName: \"kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj\") pod \"555fd11d-0b29-4116-bd0d-9419924f2c19\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") "
Jul 07 15:30:00.399853 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.399707    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca\") pod \"555fd11d-0b29-4116-bd0d-9419924f2c19\" (UID: \"555fd11d-0b29-4116-bd0d-9419924f2c19\") "
Jul 07 15:30:00.400064 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.400037    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "555fd11d-0b29-4116-bd0d-9419924f2c19" (UID: "555fd11d-0b29-4116-bd0d-9419924f2c19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:00.401924 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.401904    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "555fd11d-0b29-4116-bd0d-9419924f2c19" (UID: "555fd11d-0b29-4116-bd0d-9419924f2c19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:30:00.402031 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.401947    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj" (OuterVolumeSpecName: "kube-api-access-bzmzj") pod "555fd11d-0b29-4116-bd0d-9419924f2c19" (UID: "555fd11d-0b29-4116-bd0d-9419924f2c19"). InnerVolumeSpecName "kube-api-access-bzmzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:00.501074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.501028    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/555fd11d-0b29-4116-bd0d-9419924f2c19-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:00.501074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.501062    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/555fd11d-0b29-4116-bd0d-9419924f2c19-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:00.501074 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.501081    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzmzj\" (UniqueName: \"kubernetes.io/projected/555fd11d-0b29-4116-bd0d-9419924f2c19-kube-api-access-bzmzj\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:00.944952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.944916    2583 generic.go:356] "Generic (PLEG): container finished" podID="555fd11d-0b29-4116-bd0d-9419924f2c19" containerID="5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601" exitCode=0
Jul 07 15:30:00.945383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.944969    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"
Jul 07 15:30:00.945383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.945006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" event={"ID":"555fd11d-0b29-4116-bd0d-9419924f2c19","Type":"ContainerDied","Data":"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"}
Jul 07 15:30:00.945383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.945061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv" event={"ID":"555fd11d-0b29-4116-bd0d-9419924f2c19","Type":"ContainerDied","Data":"f16ac13e16eb558830d9a9ef9ee3d5ac1d74a7c99907f5df7dffc41ec3a7c9aa"}
Jul 07 15:30:00.945383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.945097    2583 scope.go:117] "RemoveContainer" containerID="5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"
Jul 07 15:30:00.955483 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.955468    2583 scope.go:117] "RemoveContainer" containerID="5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"
Jul 07 15:30:00.955765 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:00.955746    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601\": container with ID starting with 5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601 not found: ID does not exist" containerID="5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"
Jul 07 15:30:00.955844 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.955774    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601"} err="failed to get container status \"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601\": rpc error: code = NotFound desc = could not find container \"5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601\": container with ID starting with 5c2f96fecf8bba21848942787fa1d4d10307da60e9a3e48845188f182946b601 not found: ID does not exist"
Jul 07 15:30:00.969400 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.969376    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:30:00.975169 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:00.975148    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-03188eb0-d8bf45b9c-6r8pv"]
Jul 07 15:30:01.283747 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:01.283655    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="555fd11d-0b29-4116-bd0d-9419924f2c19" path="/var/lib/kubelet/pods/555fd11d-0b29-4116-bd0d-9419924f2c19/volumes"
Jul 07 15:30:03.918720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:03.918689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:05.958659 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:05.958622    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:06.414737 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.414647    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:30:06.435435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.435402    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:06.435803 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.435790    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="555fd11d-0b29-4116-bd0d-9419924f2c19" containerName="maas-api"
Jul 07 15:30:06.435853 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.435805    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="555fd11d-0b29-4116-bd0d-9419924f2c19" containerName="maas-api"
Jul 07 15:30:06.435892 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.435875    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="555fd11d-0b29-4116-bd0d-9419924f2c19" containerName="maas-api"
Jul 07 15:30:06.440062 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.440043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.444056 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.444032    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 15:30:06.444203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.444033    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e1d0e765-gw-openshift-default-dockercfg-lps96\""
Jul 07 15:30:06.461318 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.461280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:06.558076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj62t\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558350 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558350 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558350 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558350 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558350 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558615 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.558615 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.558415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659444 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659444 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659720 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659971 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj62t\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659971 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.659971 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659951    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.660098 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.659993    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.660250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.660230    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.660292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.660260    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.660349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.660332    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.662013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.661984    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.662112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.662085    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.669060 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.669037    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.669162 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.669119    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj62t\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t\") pod \"e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") " pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.694071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.694029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:06.750853 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.750813    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:06.758879 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.758851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:06.891381 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.891352    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:06.893491 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:30:06.893452    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374220b5_0bc7_4043_9cbd_eefc08aeb4cf.slice/crio-6f876980cc92db9b8ce0d7b65b43ee81f46bef8268793c52353279e80851aea8 WatchSource:0}: Error finding container 6f876980cc92db9b8ce0d7b65b43ee81f46bef8268793c52353279e80851aea8: Status 404 returned error can't find the container with id 6f876980cc92db9b8ce0d7b65b43ee81f46bef8268793c52353279e80851aea8
Jul 07 15:30:06.976905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:06.976810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" event={"ID":"374220b5-0bc7-4043-9cbd-eefc08aeb4cf","Type":"ContainerStarted","Data":"6f876980cc92db9b8ce0d7b65b43ee81f46bef8268793c52353279e80851aea8"}
Jul 07 15:30:07.754407 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:07.754368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:07.882348 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:07.882308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:07.949470 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:07.949434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:08.373140 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:08.373100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:08.474014 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:08.473953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:10.105028 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:10.104992    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 15:30:10.105329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:10.105068    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 15:30:10.105329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:10.105106    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 15:30:10.396821 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:10.396784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:11.002961 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:11.002929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" event={"ID":"374220b5-0bc7-4043-9cbd-eefc08aeb4cf","Type":"ContainerStarted","Data":"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"}
Jul 07 15:30:11.027390 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:11.027337    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" podStartSLOduration=1.817994603 podStartE2EDuration="5.027319558s" totalImagesPullingTime="3.209324955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:11.025503844 +0000 UTC m=+1768.291248810" watchObservedRunningTime="2026-07-07 15:30:11.027319558 +0000 UTC m=+1768.293064532"
Jul 07 15:30:11.751387 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:11.751349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:11.756529 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:11.756502    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:12.008858 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.008781    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:12.009854 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.009833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:12.328012 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.327932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:12.510556 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.510510    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:12.534250 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.534217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:12.999356 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:12.999303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:13.013970 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:13.013932    2583 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" secret="" err="secret \"e2e-migrate-e1d0e765-gw-openshift-default-dockercfg-lps96\" not found"
Jul 07 15:30:13.101842 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:13.101807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:13.200310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:13.200269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:30:13.783177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:13.783143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:14.019524 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:14.019420    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" podUID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" containerName="istio-proxy" containerID="cri-o://fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766" gracePeriod=30
Jul 07 15:30:18.732804 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:18.732767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:18.843987 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:18.843952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:18.993259 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:18.993153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:19.092348 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.092316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:19.271159 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.271132    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:19.381634 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.381839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381663    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.381839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.381839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381731    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.381839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381773    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.381839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381811    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.382097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381855    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj62t\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.382097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381878    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.382097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.381910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket\") pod \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\" (UID: \"374220b5-0bc7-4043-9cbd-eefc08aeb4cf\") "
Jul 07 15:30:19.382097 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382079    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:19.382316 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382285    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:19.382316 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382304    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:19.382433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382313    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.382433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382089    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:19.382566 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.382490    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:19.384121 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.384100    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:19.384244 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.384210    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:30:19.384332 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.384317    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:19.384432 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.384416    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t" (OuterVolumeSpecName: "kube-api-access-bj62t") pod "374220b5-0bc7-4043-9cbd-eefc08aeb4cf" (UID: "374220b5-0bc7-4043-9cbd-eefc08aeb4cf"). InnerVolumeSpecName "kube-api-access-bj62t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:19.483793 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483757    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj62t\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-kube-api-access-bj62t\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.483793 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483790    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-data\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.483793 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483800    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-credential-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.484035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483808    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istiod-ca-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.484035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483817    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-workload-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.484035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483825    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.484035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483832    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-podinfo\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:19.484035 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:19.483841    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/374220b5-0bc7-4043-9cbd-eefc08aeb4cf-istio-envoy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:20.052103 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.052065    2583 generic.go:356] "Generic (PLEG): container finished" podID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" containerID="fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766" exitCode=0
Jul 07 15:30:20.052568 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.052123    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"
Jul 07 15:30:20.052568 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.052139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" event={"ID":"374220b5-0bc7-4043-9cbd-eefc08aeb4cf","Type":"ContainerDied","Data":"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"}
Jul 07 15:30:20.052568 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.052192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq" event={"ID":"374220b5-0bc7-4043-9cbd-eefc08aeb4cf","Type":"ContainerDied","Data":"6f876980cc92db9b8ce0d7b65b43ee81f46bef8268793c52353279e80851aea8"}
Jul 07 15:30:20.052568 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.052223    2583 scope.go:117] "RemoveContainer" containerID="fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"
Jul 07 15:30:20.062239 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.062221    2583 scope.go:117] "RemoveContainer" containerID="fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"
Jul 07 15:30:20.062506 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:20.062483    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766\": container with ID starting with fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766 not found: ID does not exist" containerID="fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"
Jul 07 15:30:20.062591 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.062516    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766"} err="failed to get container status \"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766\": rpc error: code = NotFound desc = could not find container \"fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766\": container with ID starting with fe417126cfa170e53fba4543e73a230b7a3d33e9ba272120e44f92aa23adb766 not found: ID does not exist"
Jul 07 15:30:20.097325 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.097283    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:20.110430 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.110399    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e1d0e765-gw-openshift-default-6c7d4bf97f-2qnjq"]
Jul 07 15:30:20.112119 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.112091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:20.171763 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.171728    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:20.172168 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.172151    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" containerName="istio-proxy"
Jul 07 15:30:20.172257 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.172171    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" containerName="istio-proxy"
Jul 07 15:30:20.172312 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.172259    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" containerName="istio-proxy"
Jul 07 15:30:20.176565 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.176518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.182914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.182732    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-61334271-serving-cert\""
Jul 07 15:30:20.182914 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.182771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:30:20.189937 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.189910    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:20.212318 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.212290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:20.287310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.287266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:20.292354 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.292317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m82n\" (UniqueName: \"kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.292507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.292370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.292590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.292531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.393820 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.393734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.393820 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.393786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m82n\" (UniqueName: \"kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.393820 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.393814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.394415 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.394393    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.396191 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.396167    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.404775 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.404749    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m82n\" (UniqueName: \"kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n\") pod \"maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") " pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.487410 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.487370    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:20.635175 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.635138    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:20.636849 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:30:20.636825    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba756d4_baa7_4bf9_9898_db40c7f25c5c.slice/crio-5684ab53174dd832be1cd77d565eebb48f5cd45a5e10735413fd060694343832 WatchSource:0}: Error finding container 5684ab53174dd832be1cd77d565eebb48f5cd45a5e10735413fd060694343832: Status 404 returned error can't find the container with id 5684ab53174dd832be1cd77d565eebb48f5cd45a5e10735413fd060694343832
Jul 07 15:30:20.783736 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.783692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:20.880885 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:20.880847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:21.058655 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:21.058557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" event={"ID":"cba756d4-baa7-4bf9-9898-db40c7f25c5c","Type":"ContainerStarted","Data":"5684ab53174dd832be1cd77d565eebb48f5cd45a5e10735413fd060694343832"}
Jul 07 15:30:21.284258 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:21.284222    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374220b5-0bc7-4043-9cbd-eefc08aeb4cf" path="/var/lib/kubelet/pods/374220b5-0bc7-4043-9cbd-eefc08aeb4cf/volumes"
Jul 07 15:30:22.066619 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:22.066578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" event={"ID":"cba756d4-baa7-4bf9-9898-db40c7f25c5c","Type":"ContainerStarted","Data":"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"}
Jul 07 15:30:22.067048 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:22.066669    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:22.088597 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:22.088508    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" podStartSLOduration=0.805680016 podStartE2EDuration="2.088489489s" totalImagesPullingTime="1.282809473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:22.086604867 +0000 UTC m=+1779.352349843" watchObservedRunningTime="2026-07-07 15:30:22.088489489 +0000 UTC m=+1779.354234463"
Jul 07 15:30:22.124868 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:22.124831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:24.499888 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:24.499850    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:30:25.627722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.627682    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:25.628183 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.627915    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" podUID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" containerName="maas-api" containerID="cri-o://c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341" gracePeriod=30
Jul 07 15:30:25.873936 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.873912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:25.897956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.897874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:25.938725 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.938686    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls\") pod \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") "
Jul 07 15:30:25.938926 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.938734    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca\") pod \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") "
Jul 07 15:30:25.938926 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.938784    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m82n\" (UniqueName: \"kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n\") pod \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\" (UID: \"cba756d4-baa7-4bf9-9898-db40c7f25c5c\") "
Jul 07 15:30:25.939180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.939152    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cba756d4-baa7-4bf9-9898-db40c7f25c5c" (UID: "cba756d4-baa7-4bf9-9898-db40c7f25c5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:25.940821 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.940794    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cba756d4-baa7-4bf9-9898-db40c7f25c5c" (UID: "cba756d4-baa7-4bf9-9898-db40c7f25c5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:30:25.940918 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.940847    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n" (OuterVolumeSpecName: "kube-api-access-4m82n") pod "cba756d4-baa7-4bf9-9898-db40c7f25c5c" (UID: "cba756d4-baa7-4bf9-9898-db40c7f25c5c"). InnerVolumeSpecName "kube-api-access-4m82n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:25.960385 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:25.960350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:26.040271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.040232    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba756d4-baa7-4bf9-9898-db40c7f25c5c-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:26.040271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.040262    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba756d4-baa7-4bf9-9898-db40c7f25c5c-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:26.040271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.040273    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m82n\" (UniqueName: \"kubernetes.io/projected/cba756d4-baa7-4bf9-9898-db40c7f25c5c-kube-api-access-4m82n\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:26.088345 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.088309    2583 generic.go:356] "Generic (PLEG): container finished" podID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" containerID="c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341" exitCode=0
Jul 07 15:30:26.088558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.088356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" event={"ID":"cba756d4-baa7-4bf9-9898-db40c7f25c5c","Type":"ContainerDied","Data":"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"}
Jul 07 15:30:26.088558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.088363    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"
Jul 07 15:30:26.088558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.088410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb" event={"ID":"cba756d4-baa7-4bf9-9898-db40c7f25c5c","Type":"ContainerDied","Data":"5684ab53174dd832be1cd77d565eebb48f5cd45a5e10735413fd060694343832"}
Jul 07 15:30:26.088558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.088442    2583 scope.go:117] "RemoveContainer" containerID="c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"
Jul 07 15:30:26.098419 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.098401    2583 scope.go:117] "RemoveContainer" containerID="c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"
Jul 07 15:30:26.098752 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:26.098733    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341\": container with ID starting with c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341 not found: ID does not exist" containerID="c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"
Jul 07 15:30:26.098810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.098760    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341"} err="failed to get container status \"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341\": rpc error: code = NotFound desc = could not find container \"c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341\": container with ID starting with c5cd878bbcc7b439de9378f60c81f4082a99a70549b56252b6976905a103b341 not found: ID does not exist"
Jul 07 15:30:26.113940 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.113908    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:26.118871 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:26.118844    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-61334271-77f5d8c5b5-c2pcb"]
Jul 07 15:30:27.284973 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:27.284931    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" path="/var/lib/kubelet/pods/cba756d4-baa7-4bf9-9898-db40c7f25c5c/volumes"
Jul 07 15:30:31.492076 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:31.492039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:31.595453 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:31.595420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:33.482609 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:33.482577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:36.348533 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:36.348453    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:30:37.501008 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:37.500976    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:37.567488 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:37.567440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:37.738640 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:37.738599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:37.839102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:37.839001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:38.926481 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:38.926435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.024814 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.024776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.028962 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.028937    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:39.029304 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.029291    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" containerName="maas-api"
Jul 07 15:30:39.029354 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.029305    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" containerName="maas-api"
Jul 07 15:30:39.029396 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.029377    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba756d4-baa7-4bf9-9898-db40c7f25c5c" containerName="maas-api"
Jul 07 15:30:39.032373 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.032357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.035710 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.035663    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:30:39.035859 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.035841    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-caa09bda-serving-cert\""
Jul 07 15:30:39.045141 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.045115    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:39.105485 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.105448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.160861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.160830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czr6j\" (UniqueName: \"kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.161042 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.160882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.161042 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.160942    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.261637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.261525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.261637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.261610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.261862 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.261733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czr6j\" (UniqueName: \"kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.261862 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:39.261772    2583 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-caa09bda-serving-cert: secret "maas-api-e2e-derive-caa09bda-serving-cert" not found
Jul 07 15:30:39.261967 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:39.261888    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls podName:3dd42067-ee43-41d8-bb06-379fa800bcd2 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:39.761865295 +0000 UTC m=+1797.027610264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls") pod "maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" (UID: "3dd42067-ee43-41d8-bb06-379fa800bcd2") : secret "maas-api-e2e-derive-caa09bda-serving-cert" not found
Jul 07 15:30:39.262308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.262290    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.271861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.271834    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czr6j\" (UniqueName: \"kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.605928 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.605822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.722921 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.722888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.767735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.767700    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:39.767897 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:39.767854    2583 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-caa09bda-serving-cert: secret "maas-api-e2e-derive-caa09bda-serving-cert" not found
Jul 07 15:30:39.767962 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:39.767914    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls podName:3dd42067-ee43-41d8-bb06-379fa800bcd2 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:40.767898516 +0000 UTC m=+1798.033643469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls") pod "maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" (UID: "3dd42067-ee43-41d8-bb06-379fa800bcd2") : secret "maas-api-e2e-derive-caa09bda-serving-cert" not found
Jul 07 15:30:39.860828 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:39.860745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:40.776426 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:40.776385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:40.778787 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:40.778758    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") " pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:40.843404 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:40.843359    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:40.983208 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:40.983182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:40.984692 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:30:40.984663    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd42067_ee43_41d8_bb06_379fa800bcd2.slice/crio-35499ad2a0c892f7d3c1b6de3fbee447cb52197dd15ced4ef3a48705ba31a8f3 WatchSource:0}: Error finding container 35499ad2a0c892f7d3c1b6de3fbee447cb52197dd15ced4ef3a48705ba31a8f3: Status 404 returned error can't find the container with id 35499ad2a0c892f7d3c1b6de3fbee447cb52197dd15ced4ef3a48705ba31a8f3
Jul 07 15:30:41.169612 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:41.169574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" event={"ID":"3dd42067-ee43-41d8-bb06-379fa800bcd2","Type":"ContainerStarted","Data":"35499ad2a0c892f7d3c1b6de3fbee447cb52197dd15ced4ef3a48705ba31a8f3"}
Jul 07 15:30:41.797975 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:41.797931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:42.176180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:42.176147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" event={"ID":"3dd42067-ee43-41d8-bb06-379fa800bcd2","Type":"ContainerStarted","Data":"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"}
Jul 07 15:30:42.176360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:42.176227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:42.198488 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:42.198435    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" podStartSLOduration=3.702158752 podStartE2EDuration="4.198420912s" totalImagesPullingTime="496.26216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:42.196950142 +0000 UTC m=+1799.462695118" watchObservedRunningTime="2026-07-07 15:30:42.198420912 +0000 UTC m=+1799.464165888"
Jul 07 15:30:43.330922 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:43.330886    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:43.663450 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:43.663357    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:44.187078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.187036    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" podUID="3dd42067-ee43-41d8-bb06-379fa800bcd2" containerName="maas-api" containerID="cri-o://c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9" gracePeriod=30
Jul 07 15:30:44.273381 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.273343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:44.433762 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.433740    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:44.513146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.513052    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca\") pod \"3dd42067-ee43-41d8-bb06-379fa800bcd2\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") "
Jul 07 15:30:44.513146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.513136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") pod \"3dd42067-ee43-41d8-bb06-379fa800bcd2\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") "
Jul 07 15:30:44.513341 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.513189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czr6j\" (UniqueName: \"kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j\") pod \"3dd42067-ee43-41d8-bb06-379fa800bcd2\" (UID: \"3dd42067-ee43-41d8-bb06-379fa800bcd2\") "
Jul 07 15:30:44.513505 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.513484    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3dd42067-ee43-41d8-bb06-379fa800bcd2" (UID: "3dd42067-ee43-41d8-bb06-379fa800bcd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:44.515270 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.515245    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3dd42067-ee43-41d8-bb06-379fa800bcd2" (UID: "3dd42067-ee43-41d8-bb06-379fa800bcd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:30:44.515381 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.515279    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j" (OuterVolumeSpecName: "kube-api-access-czr6j") pod "3dd42067-ee43-41d8-bb06-379fa800bcd2" (UID: "3dd42067-ee43-41d8-bb06-379fa800bcd2"). InnerVolumeSpecName "kube-api-access-czr6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:44.614214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.614164    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czr6j\" (UniqueName: \"kubernetes.io/projected/3dd42067-ee43-41d8-bb06-379fa800bcd2-kube-api-access-czr6j\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:44.614214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.614201    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd42067-ee43-41d8-bb06-379fa800bcd2-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:44.614214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:44.614211    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd42067-ee43-41d8-bb06-379fa800bcd2-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:30:45.160847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.160811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:45.193738 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.193707    2583 generic.go:356] "Generic (PLEG): container finished" podID="3dd42067-ee43-41d8-bb06-379fa800bcd2" containerID="c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9" exitCode=0
Jul 07 15:30:45.193909 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.193771    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"
Jul 07 15:30:45.193909 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.193791    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" event={"ID":"3dd42067-ee43-41d8-bb06-379fa800bcd2","Type":"ContainerDied","Data":"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"}
Jul 07 15:30:45.193909 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.193870    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5" event={"ID":"3dd42067-ee43-41d8-bb06-379fa800bcd2","Type":"ContainerDied","Data":"35499ad2a0c892f7d3c1b6de3fbee447cb52197dd15ced4ef3a48705ba31a8f3"}
Jul 07 15:30:45.193909 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.193893    2583 scope.go:117] "RemoveContainer" containerID="c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"
Jul 07 15:30:45.203563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.203524    2583 scope.go:117] "RemoveContainer" containerID="c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"
Jul 07 15:30:45.203841 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:30:45.203823    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9\": container with ID starting with c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9 not found: ID does not exist" containerID="c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"
Jul 07 15:30:45.203931 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.203849    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9"} err="failed to get container status \"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9\": rpc error: code = NotFound desc = could not find container \"c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9\": container with ID starting with c966a8e573a941a4a417675fd566ae6ae277d9675a0069e02a5ac6b8eff90ba9 not found: ID does not exist"
Jul 07 15:30:45.216391 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.216360    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:45.221199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.221174    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-caa09bda-54c4554dd6-xrwt5"]
Jul 07 15:30:45.284552 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.284513    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd42067-ee43-41d8-bb06-379fa800bcd2" path="/var/lib/kubelet/pods/3dd42067-ee43-41d8-bb06-379fa800bcd2/volumes"
Jul 07 15:30:45.659008 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:45.658970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.590731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:49.590688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.684330 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:49.684295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:50.137704 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:50.137664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:50.244516 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:50.244480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:50.346450 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:50.346416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:51.898530 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:51.898489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:58.799687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:58.799644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:58.896685 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:58.896647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.122880 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:30:59.122788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:04.195289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:04.195254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:25.148218 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:25.148177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.018435 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:31.018389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.134157 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:31.134117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.240837 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:31.240797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:47.281154 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:47.281115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:53.267941 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:53.267900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:53.337457 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:53.337386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:53.437472 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:31:53.437427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:04.027889 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:04.027846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:04.892961 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:04.892874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:10.753972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:10.753934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:10.822361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:10.822321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:10.902449 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:10.902413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:11.002357 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:11.002319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:11.104177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:11.104073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:11.907507 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:11.907471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:12.007711 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:12.007673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:12.108070 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:12.108037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:13.302476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:13.302441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:32:13.892796 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:13.892754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:19.765112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:19.765061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:19.838556 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:19.838498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:20.479649 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:20.479613    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:20.900371 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:20.900281    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:32:26.287208 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:26.287153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:26.353740 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:26.353703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:26.553275 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:26.553183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:26.894987 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:26.894899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:27.371615 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:27.371582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.117469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.117436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.193018 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.192977    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:30.193606 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.193557    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd42067-ee43-41d8-bb06-379fa800bcd2" containerName="maas-api"
Jul 07 15:32:30.193606 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.193581    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd42067-ee43-41d8-bb06-379fa800bcd2" containerName="maas-api"
Jul 07 15:32:30.193748 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.193685    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd42067-ee43-41d8-bb06-379fa800bcd2" containerName="maas-api"
Jul 07 15:32:30.196882 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.196866    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.199772 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.199748    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:32:30.200248 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.200231    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5a854080-serving-cert\""
Jul 07 15:32:30.206292 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.206269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:30.314341 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.314308    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:32:30.362125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.362086    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznn5\" (UniqueName: \"kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.362125 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.362129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.362371 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.362205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.418149 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.418121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.463072 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.463029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznn5\" (UniqueName: \"kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.463240 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.463086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.463240 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.463129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.463352 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:32:30.463239    2583 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-5a854080-serving-cert: secret "maas-api-e2e-mt-5a854080-serving-cert" not found
Jul 07 15:32:30.463352 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:32:30.463329    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls podName:16e8a19b-4ff2-4399-b6ac-86974838da8d nodeName:}" failed. No retries permitted until 2026-07-07 15:32:30.963307278 +0000 UTC m=+1908.229052234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls") pod "maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" (UID: "16e8a19b-4ff2-4399-b6ac-86974838da8d") : secret "maas-api-e2e-mt-5a854080-serving-cert" not found
Jul 07 15:32:30.463851 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.463830    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.472780 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.472752    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznn5\" (UniqueName: \"kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.531627 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.531588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.636995 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.636960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.743960 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.743857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.842991 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.842956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:30.967505 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.967466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:30.970006 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:30.969975    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") pod \"maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") " pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:31.108917 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:31.108827    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:31.248974 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:31.248950    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:31.251258 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:32:31.251232    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e8a19b_4ff2_4399_b6ac_86974838da8d.slice/crio-e4a98dad4111fbf1715f378ed4210fe0c98026ac3b43fa5fa6e417b48782a7bb WatchSource:0}: Error finding container e4a98dad4111fbf1715f378ed4210fe0c98026ac3b43fa5fa6e417b48782a7bb: Status 404 returned error can't find the container with id e4a98dad4111fbf1715f378ed4210fe0c98026ac3b43fa5fa6e417b48782a7bb
Jul 07 15:32:31.769908 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:31.769874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" event={"ID":"16e8a19b-4ff2-4399-b6ac-86974838da8d","Type":"ContainerStarted","Data":"e4a98dad4111fbf1715f378ed4210fe0c98026ac3b43fa5fa6e417b48782a7bb"}
Jul 07 15:32:32.776726 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:32.776690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" event={"ID":"16e8a19b-4ff2-4399-b6ac-86974838da8d","Type":"ContainerStarted","Data":"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"}
Jul 07 15:32:32.777140 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:32.776750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:32.793987 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:32.793934    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" podStartSLOduration=2.148297654 podStartE2EDuration="2.793917575s" totalImagesPullingTime="645.619921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:32:32.792943675 +0000 UTC m=+1910.058688652" watchObservedRunningTime="2026-07-07 15:32:32.793917575 +0000 UTC m=+1910.059662550"
Jul 07 15:32:34.642681 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:34.642638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:35.349229 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:35.349182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:35.451861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:35.451823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:35.813634 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:35.813592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:38.787788 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:38.787754    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:40.012099 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:40.012054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:32:41.687515 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:41.687485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:41.751025 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:41.750987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:42.133686 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.133590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:42.465977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.465944    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:42.466217 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.466194    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" podUID="16e8a19b-4ff2-4399-b6ac-86974838da8d" containerName="maas-api" containerID="cri-o://6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415" gracePeriod=30
Jul 07 15:32:42.499232 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.499200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:42.599898 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.599867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:42.719469 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.719404    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:42.761119 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.761077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") pod \"16e8a19b-4ff2-4399-b6ac-86974838da8d\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") "
Jul 07 15:32:42.761305 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.761134    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fznn5\" (UniqueName: \"kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5\") pod \"16e8a19b-4ff2-4399-b6ac-86974838da8d\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") "
Jul 07 15:32:42.761305 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.761171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca\") pod \"16e8a19b-4ff2-4399-b6ac-86974838da8d\" (UID: \"16e8a19b-4ff2-4399-b6ac-86974838da8d\") "
Jul 07 15:32:42.761509 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.761486    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16e8a19b-4ff2-4399-b6ac-86974838da8d" (UID: "16e8a19b-4ff2-4399-b6ac-86974838da8d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:42.763172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.763150    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16e8a19b-4ff2-4399-b6ac-86974838da8d" (UID: "16e8a19b-4ff2-4399-b6ac-86974838da8d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:42.763254 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.763213    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5" (OuterVolumeSpecName: "kube-api-access-fznn5") pod "16e8a19b-4ff2-4399-b6ac-86974838da8d" (UID: "16e8a19b-4ff2-4399-b6ac-86974838da8d"). InnerVolumeSpecName "kube-api-access-fznn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:32:42.828926 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.828893    2583 generic.go:356] "Generic (PLEG): container finished" podID="16e8a19b-4ff2-4399-b6ac-86974838da8d" containerID="6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415" exitCode=0
Jul 07 15:32:42.829109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.828938    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"
Jul 07 15:32:42.829109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.828948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" event={"ID":"16e8a19b-4ff2-4399-b6ac-86974838da8d","Type":"ContainerDied","Data":"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"}
Jul 07 15:32:42.829109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.828990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b" event={"ID":"16e8a19b-4ff2-4399-b6ac-86974838da8d","Type":"ContainerDied","Data":"e4a98dad4111fbf1715f378ed4210fe0c98026ac3b43fa5fa6e417b48782a7bb"}
Jul 07 15:32:42.829109 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.829011    2583 scope.go:117] "RemoveContainer" containerID="6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"
Jul 07 15:32:42.838839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.838814    2583 scope.go:117] "RemoveContainer" containerID="6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"
Jul 07 15:32:42.839108 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:32:42.839089    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415\": container with ID starting with 6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415 not found: ID does not exist" containerID="6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"
Jul 07 15:32:42.839164 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.839116    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415"} err="failed to get container status \"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415\": rpc error: code = NotFound desc = could not find container \"6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415\": container with ID starting with 6d30863079d4af81140bdff54718fb0a8e40fd28c48c8a36dc701587bbecb415 not found: ID does not exist"
Jul 07 15:32:42.851180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.851154    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:42.855474 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.855451    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a854080-6d4bdc969b-jt87b"]
Jul 07 15:32:42.861734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.861715    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e8a19b-4ff2-4399-b6ac-86974838da8d-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:32:42.861795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.861738    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fznn5\" (UniqueName: \"kubernetes.io/projected/16e8a19b-4ff2-4399-b6ac-86974838da8d-kube-api-access-fznn5\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:32:42.861795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:42.861751    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e8a19b-4ff2-4399-b6ac-86974838da8d-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:32:43.284466 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:43.284431    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e8a19b-4ff2-4399-b6ac-86974838da8d" path="/var/lib/kubelet/pods/16e8a19b-4ff2-4399-b6ac-86974838da8d/volumes"
Jul 07 15:32:46.907905 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:46.907871    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:32:48.536966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:48.536921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:50.659440 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:50.659408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:55.212514 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:55.212473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:55.277578 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:55.277514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:55.369604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:55.369571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:55.469519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:55.469432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:55.620145 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:55.620104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:59.864502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:59.864459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:59.965153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:32:59.965114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:01.403939 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:01.403889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:01.494682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:01.494641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:08.395934 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:08.395900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:08.770631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:08.770577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:08.978867 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:08.978826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:11.427703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:11.427669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:11.531659 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:11.531614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:11.683503 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:11.683396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:11.942785 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:11.942681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:12.043415 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:12.043380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:15.818513 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:15.818462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:16.499634 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:16.499597    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:33:28.731843 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:28.731800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:31.788134 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:31.788093    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:33:47.901041 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:47.900939    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:33:53.474703 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:53.474664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:53.895264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:53.895163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:57.998373 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:57.998336    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:33:59.631187 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:33:59.631152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:04.683234 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:04.683190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:07.592102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:07.592064    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:34:40.829492 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:40.829456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:41.588761 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:41.588723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:44.299820 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:44.299778    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:34:47.137082 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:47.137041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:47.222042 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:47.222000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:47.460672 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:47.460633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:47.708728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:47.708689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:48.847191 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:48.847133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:48.937884 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:48.937851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:49.036931 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:49.036898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:49.857320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:49.857286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:49.942897 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:49.942860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:50.044590 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:50.044554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:51.543857 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:51.543825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:53.399907 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:53.399872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:34:57.355997 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:57.355963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:57.426631 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:57.426600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:58.054306 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:34:58.054270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:04.065317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:04.065277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:04.175211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:04.175174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:04.347264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:04.347159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:05.870360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:05.870324    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:35:14.833477 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:14.833442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:15.187692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:15.187653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:36.203199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:36.203157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:40.960865 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:40.960822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:41.063952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:41.063916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:42.033775 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:42.033740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:42.134311 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:42.134273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:42.402445 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:42.402312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:42.727412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:42.727377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:43.149379 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:43.149266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.116680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.116625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.216837 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.216800    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:35:46.217172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.217158    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e8a19b-4ff2-4399-b6ac-86974838da8d" containerName="maas-api"
Jul 07 15:35:46.217219 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.217174    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e8a19b-4ff2-4399-b6ac-86974838da8d" containerName="maas-api"
Jul 07 15:35:46.217255 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.217241    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e8a19b-4ff2-4399-b6ac-86974838da8d" containerName="maas-api"
Jul 07 15:35:46.220332 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.220309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.220786 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.220755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mcql\" (UniqueName: \"kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.220906 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.220845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.220906 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.220873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.221993 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.221971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.240361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.240325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:35:46.251687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.251666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:35:46.251687 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.251682    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-6c4fac-serving-cert\""
Jul 07 15:35:46.322013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.321977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.322013 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.322010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.322284 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:35:46.322126    2583 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-6c4fac-serving-cert: secret "maas-api-e2e-inf-a-6c4fac-serving-cert" not found
Jul 07 15:35:46.322284 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:35:46.322199    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls podName:511c8a17-e457-49bb-9d37-f90abd6800be nodeName:}" failed. No retries permitted until 2026-07-07 15:35:46.822178243 +0000 UTC m=+2104.087923203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls") pod "maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" (UID: "511c8a17-e457-49bb-9d37-f90abd6800be") : secret "maas-api-e2e-inf-a-6c4fac-serving-cert" not found
Jul 07 15:35:46.322284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.322275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mcql\" (UniqueName: \"kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.322697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.322680    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.331893 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.331860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.334576 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.334557    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mcql\" (UniqueName: \"kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.740684 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.740650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.826171 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.826128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.828528 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.828501    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") " pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.836735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.836710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:46.961237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.961200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:46.974130 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.974105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:35:46.975549 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:35:46.975509    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511c8a17_e457_49bb_9d37_f90abd6800be.slice/crio-745d0df672a6b58967324099b98891f14566e860227bbbecdd7ef99bd33bcb0b WatchSource:0}: Error finding container 745d0df672a6b58967324099b98891f14566e860227bbbecdd7ef99bd33bcb0b: Status 404 returned error can't find the container with id 745d0df672a6b58967324099b98891f14566e860227bbbecdd7ef99bd33bcb0b
Jul 07 15:35:46.977284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:46.977268    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:35:47.061279 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:47.061195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:47.797734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:47.797630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" event={"ID":"511c8a17-e457-49bb-9d37-f90abd6800be","Type":"ContainerStarted","Data":"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"}
Jul 07 15:35:47.797734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:47.797692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" event={"ID":"511c8a17-e457-49bb-9d37-f90abd6800be","Type":"ContainerStarted","Data":"745d0df672a6b58967324099b98891f14566e860227bbbecdd7ef99bd33bcb0b"}
Jul 07 15:35:47.797734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:47.797719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:47.818846 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:47.818788    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" podStartSLOduration=1.318349652 podStartE2EDuration="1.818769189s" totalImagesPullingTime="500.419537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:47.818065998 +0000 UTC m=+2105.083810973" watchObservedRunningTime="2026-07-07 15:35:47.818769189 +0000 UTC m=+2105.084514161"
Jul 07 15:35:50.634186 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:50.634150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:51.007378 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:51.007341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:51.699622 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:51.699574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.377913 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:52.377871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:53.307837 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:53.307800    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:35:53.808820 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:53.808792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:35:54.130223 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.130104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:54.231260 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.231223    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:54.314151 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.314112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:54.587735 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.587702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:54.843364 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.843268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:54.938320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:54.938283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:58.630476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:35:58.630440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:04.906272 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:04.906229    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:36:06.997071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:06.997034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:07.707906 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:07.707870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:07.821018 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:07.820980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:12.416965 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:12.416927    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:36:16.496185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:16.496145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:16.601261 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:16.601225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:21.438447 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.438409    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:36:21.441878 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.441860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.445412 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.445389    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c5eea1\"/\"openshift-service-ca.crt\""
Jul 07 15:36:21.445567 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.445449    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c5eea1\"/\"default-dockercfg-lkjr5\""
Jul 07 15:36:21.446867 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.446848    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c5eea1\"/\"test-model-c5eea1-kserve-self-signed-certs\""
Jul 07 15:36:21.446986 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.446972    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c5eea1\"/\"kube-root-ca.crt\""
Jul 07 15:36:21.456863 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.456839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:36:21.514112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.514112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.514320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.514320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.514320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.514418 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.514328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdjs\" (UniqueName: \"kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.603663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.603623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:21.615708 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.615708 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.615956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.615956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.615956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.615956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.615831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdjs\" (UniqueName: \"kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.616177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.616107    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.616237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.616216    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.616284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.616253    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.618075 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.618053    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.618330 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.618314    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.625705 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.625678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdjs\" (UniqueName: \"kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs\") pod \"test-model-c5eea1-kserve-577fb45b45-bxfgn\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") " pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.751699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.751607    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:21.893684 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.893659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:36:21.895517 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:36:21.895490    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f06b75b_4b78_42f6_a116_8c02a16f3411.slice/crio-0dedaabfa0d806de2f977ac99efeaea54c67d3ac3b3c3ae4450fa8b731b9c1c6 WatchSource:0}: Error finding container 0dedaabfa0d806de2f977ac99efeaea54c67d3ac3b3c3ae4450fa8b731b9c1c6: Status 404 returned error can't find the container with id 0dedaabfa0d806de2f977ac99efeaea54c67d3ac3b3c3ae4450fa8b731b9c1c6
Jul 07 15:36:21.978374 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:21.978337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" event={"ID":"4f06b75b-4b78-42f6-a116-8c02a16f3411","Type":"ContainerStarted","Data":"0dedaabfa0d806de2f977ac99efeaea54c67d3ac3b3c3ae4450fa8b731b9c1c6"}
Jul 07 15:36:23.990080 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:23.990043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" event={"ID":"4f06b75b-4b78-42f6-a116-8c02a16f3411","Type":"ContainerStarted","Data":"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"}
Jul 07 15:36:24.016081 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:24.016025    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" podStartSLOduration=1.931086332 podStartE2EDuration="3.016009809s" totalImagesPullingTime="1.084923477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:24.014509784 +0000 UTC m=+2141.280254762" watchObservedRunningTime="2026-07-07 15:36:24.016009809 +0000 UTC m=+2141.281754785"
Jul 07 15:36:26.012077 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:26.012036    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:36:31.752795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:31.752750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:31.753222 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:31.752815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:31.765366 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:31.765335    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:32.042180 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:32.042100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:36:40.038360 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:40.038268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:36:47.233172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:47.233125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:48.277873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:48.277842    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:36:48.301450 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:48.301419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:48.470479 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:48.470447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:48.997389 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:48.997353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:49.110451 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.110412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:49.211927 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.211882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:49.336128 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.336047    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:36:49.336532 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.336236    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" podUID="511c8a17-e457-49bb-9d37-f90abd6800be" containerName="maas-api" containerID="cri-o://8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe" gracePeriod=30
Jul 07 15:36:49.364727 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.364689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:49.582767 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.582742    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:36:49.669003 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.668974    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") pod \"511c8a17-e457-49bb-9d37-f90abd6800be\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") "
Jul 07 15:36:49.669203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.669051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mcql\" (UniqueName: \"kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql\") pod \"511c8a17-e457-49bb-9d37-f90abd6800be\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") "
Jul 07 15:36:49.669203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.669117    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca\") pod \"511c8a17-e457-49bb-9d37-f90abd6800be\" (UID: \"511c8a17-e457-49bb-9d37-f90abd6800be\") "
Jul 07 15:36:49.669508 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.669486    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "511c8a17-e457-49bb-9d37-f90abd6800be" (UID: "511c8a17-e457-49bb-9d37-f90abd6800be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:36:49.671141 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.671122    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "511c8a17-e457-49bb-9d37-f90abd6800be" (UID: "511c8a17-e457-49bb-9d37-f90abd6800be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:36:49.671229 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.671208    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql" (OuterVolumeSpecName: "kube-api-access-2mcql") pod "511c8a17-e457-49bb-9d37-f90abd6800be" (UID: "511c8a17-e457-49bb-9d37-f90abd6800be"). InnerVolumeSpecName "kube-api-access-2mcql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:36:49.769831 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.769791    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511c8a17-e457-49bb-9d37-f90abd6800be-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:36:49.769831 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.769823    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mcql\" (UniqueName: \"kubernetes.io/projected/511c8a17-e457-49bb-9d37-f90abd6800be-kube-api-access-2mcql\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:36:49.770043 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:49.769832    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511c8a17-e457-49bb-9d37-f90abd6800be-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:36:50.128571 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.128463    2583 generic.go:356] "Generic (PLEG): container finished" podID="511c8a17-e457-49bb-9d37-f90abd6800be" containerID="8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe" exitCode=0
Jul 07 15:36:50.128571 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.128510    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"
Jul 07 15:36:50.128807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.128570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" event={"ID":"511c8a17-e457-49bb-9d37-f90abd6800be","Type":"ContainerDied","Data":"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"}
Jul 07 15:36:50.128807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.128632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd" event={"ID":"511c8a17-e457-49bb-9d37-f90abd6800be","Type":"ContainerDied","Data":"745d0df672a6b58967324099b98891f14566e860227bbbecdd7ef99bd33bcb0b"}
Jul 07 15:36:50.128807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.128662    2583 scope.go:117] "RemoveContainer" containerID="8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"
Jul 07 15:36:50.138051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.138034    2583 scope.go:117] "RemoveContainer" containerID="8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"
Jul 07 15:36:50.138307 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:36:50.138287    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe\": container with ID starting with 8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe not found: ID does not exist" containerID="8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"
Jul 07 15:36:50.138349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.138316    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe"} err="failed to get container status \"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe\": rpc error: code = NotFound desc = could not find container \"8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe\": container with ID starting with 8134cf00cdebab326509db799d7a665c7889b28f16d8e35a161a9d3eceb7cffe not found: ID does not exist"
Jul 07 15:36:50.152243 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.152218    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:36:50.158048 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:50.158022    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-6c4fac-6fc6b556cd-dhfkd"]
Jul 07 15:36:51.283757 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:51.283716    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="511c8a17-e457-49bb-9d37-f90abd6800be" path="/var/lib/kubelet/pods/511c8a17-e457-49bb-9d37-f90abd6800be/volumes"
Jul 07 15:36:53.497722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:53.497683    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:36:54.000987 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:36:54.000955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:03.298528 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.298492    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" podUID="4f06b75b-4b78-42f6-a116-8c02a16f3411" containerName="main" containerID="cri-o://58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5" gracePeriod=45
Jul 07 15:37:03.556160 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.556093    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:37:03.700471 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700471 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700471    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsdjs\" (UniqueName: \"kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700502    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700563    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700869 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700655    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache\") pod \"4f06b75b-4b78-42f6-a116-8c02a16f3411\" (UID: \"4f06b75b-4b78-42f6-a116-8c02a16f3411\") "
Jul 07 15:37:03.700869 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700788    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:03.700869 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700825    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home" (OuterVolumeSpecName: "home") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:03.700869 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.700856    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:03.701066 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.701041    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-tmp-dir\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:03.701066 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.701056    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-home\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:03.701167 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.701069    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-model-cache\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:03.702893 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.702868    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm" (OuterVolumeSpecName: "dshm") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:03.703007 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.702889    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs" (OuterVolumeSpecName: "kube-api-access-qsdjs") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "kube-api-access-qsdjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:37:03.703007 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.702942    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f06b75b-4b78-42f6-a116-8c02a16f3411" (UID: "4f06b75b-4b78-42f6-a116-8c02a16f3411"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:37:03.801682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.801641    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsdjs\" (UniqueName: \"kubernetes.io/projected/4f06b75b-4b78-42f6-a116-8c02a16f3411-kube-api-access-qsdjs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:03.801682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.801675    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f06b75b-4b78-42f6-a116-8c02a16f3411-tls-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:03.801682 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:03.801687    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f06b75b-4b78-42f6-a116-8c02a16f3411-dshm\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:37:04.207847 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.207815    2583 generic.go:356] "Generic (PLEG): container finished" podID="4f06b75b-4b78-42f6-a116-8c02a16f3411" containerID="58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5" exitCode=0
Jul 07 15:37:04.208032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.207863    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"
Jul 07 15:37:04.208032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.207894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" event={"ID":"4f06b75b-4b78-42f6-a116-8c02a16f3411","Type":"ContainerDied","Data":"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"}
Jul 07 15:37:04.208032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.207930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn" event={"ID":"4f06b75b-4b78-42f6-a116-8c02a16f3411","Type":"ContainerDied","Data":"0dedaabfa0d806de2f977ac99efeaea54c67d3ac3b3c3ae4450fa8b731b9c1c6"}
Jul 07 15:37:04.208032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.207950    2583 scope.go:117] "RemoveContainer" containerID="58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"
Jul 07 15:37:04.217385 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.217365    2583 scope.go:117] "RemoveContainer" containerID="58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"
Jul 07 15:37:04.217722 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:37:04.217701    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5\": container with ID starting with 58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5 not found: ID does not exist" containerID="58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"
Jul 07 15:37:04.217804 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.217734    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5"} err="failed to get container status \"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5\": rpc error: code = NotFound desc = could not find container \"58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5\": container with ID starting with 58b35bad676abec68544a1c2ed499bc590aa1139f993562f1e5b59443e8493d5 not found: ID does not exist"
Jul 07 15:37:04.229844 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.229816    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:37:04.233797 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:04.233771    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c5eea1/test-model-c5eea1-kserve-577fb45b45-bxfgn"]
Jul 07 15:37:05.284773 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:05.284728    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f06b75b-4b78-42f6-a116-8c02a16f3411" path="/var/lib/kubelet/pods/4f06b75b-4b78-42f6-a116-8c02a16f3411/volumes"
Jul 07 15:37:30.752123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:30.752089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:31.026879 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:31.026791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:31.285117 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:31.285016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:31.473802 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:31.473765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:31.973859 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:31.973822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:32.074017 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:32.073985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:32.173383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:32.173348    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:32.300166 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:32.300068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:35.204871 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:35.204836    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:37:37.853433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:37.853391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:37.925421 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:37.925379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:38.155615 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:38.155498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:38.414873 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:38.414783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:38.797348 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:38.797309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:38.895251 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:38.895209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:39.155227 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:39.155122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:39.625034 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:39.625002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:41.686123 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.686086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:41.772966 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.772927    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:37:41.773326 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773313    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f06b75b-4b78-42f6-a116-8c02a16f3411" containerName="main"
Jul 07 15:37:41.773388 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773328    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f06b75b-4b78-42f6-a116-8c02a16f3411" containerName="main"
Jul 07 15:37:41.773388 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773371    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="511c8a17-e457-49bb-9d37-f90abd6800be" containerName="maas-api"
Jul 07 15:37:41.773388 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773377    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="511c8a17-e457-49bb-9d37-f90abd6800be" containerName="maas-api"
Jul 07 15:37:41.773564 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773457    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f06b75b-4b78-42f6-a116-8c02a16f3411" containerName="main"
Jul 07 15:37:41.773564 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.773469    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="511c8a17-e457-49bb-9d37-f90abd6800be" containerName="maas-api"
Jul 07 15:37:41.776749 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.776729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.780502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.780483    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-ad5677-serving-cert\""
Jul 07 15:37:41.780613 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.780500    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:37:41.792184 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.792158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:37:41.799936 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.799909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:41.809676 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.809641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.809817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.809691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.809817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.809736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r479p\" (UniqueName: \"kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.901138 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.901096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:41.910210 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.910180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.910317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.910231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.910317 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.910275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r479p\" (UniqueName: \"kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.910422 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:37:41.910406    2583 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-ad5677-serving-cert: secret "maas-api-e2e-api-a-ad5677-serving-cert" not found
Jul 07 15:37:41.910485 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:37:41.910473    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls podName:feef718c-27e2-41d7-831d-68007b0ce1e5 nodeName:}" failed. No retries permitted until 2026-07-07 15:37:42.410452861 +0000 UTC m=+2219.676197814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls") pod "maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" (UID: "feef718c-27e2-41d7-831d-68007b0ce1e5") : secret "maas-api-e2e-api-a-ad5677-serving-cert" not found
Jul 07 15:37:41.910999 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.910978    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:41.922637 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:41.922605    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r479p\" (UniqueName: \"kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:42.031502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.031414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:42.414293 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.414200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:42.416658 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.416629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") pod \"maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") " pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:42.418078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.418049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:42.520131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.520091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:42.686438 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.686409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:42.827519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:42.827495    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:37:42.829678 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:37:42.829652    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeef718c_27e2_41d7_831d_68007b0ce1e5.slice/crio-163da7420330065dfed009c561f16c723b021749f47342f90f941acda21be085 WatchSource:0}: Error finding container 163da7420330065dfed009c561f16c723b021749f47342f90f941acda21be085: Status 404 returned error can't find the container with id 163da7420330065dfed009c561f16c723b021749f47342f90f941acda21be085
Jul 07 15:37:43.416616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:43.416575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" event={"ID":"feef718c-27e2-41d7-831d-68007b0ce1e5","Type":"ContainerStarted","Data":"7090556d3360e35af9ea1b737f0c02a2f49b26367c22020182a5a431611e636a"}
Jul 07 15:37:43.416807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:43.416643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" event={"ID":"feef718c-27e2-41d7-831d-68007b0ce1e5","Type":"ContainerStarted","Data":"163da7420330065dfed009c561f16c723b021749f47342f90f941acda21be085"}
Jul 07 15:37:43.416807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:43.416671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:43.448325 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:43.448214    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" podStartSLOduration=2.086157241 podStartE2EDuration="2.448198171s" totalImagesPullingTime="362.04093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:43.447923974 +0000 UTC m=+2220.713668963" watchObservedRunningTime="2026-07-07 15:37:43.448198171 +0000 UTC m=+2220.713943194"
Jul 07 15:37:46.218805 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:46.218767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:46.709615 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:46.709583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:47.101657 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:47.101556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:47.234280 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:47.234242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:49.428403 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:49.428370    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:37:49.783176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:49.783061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:49.870893 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:49.870859    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:37:49.949374 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:49.949149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:50.099645 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:50.099527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:50.223207 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:50.223173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:50.770241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:50.770210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:52.292484 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:52.292450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:54.286101 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:37:54.286066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:00.604790 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:00.604738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:00.708271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:00.708234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:02.613970 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:02.613930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:03.044892 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.044839    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:03.144565 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.144514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:03.244144 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.244103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:03.319396 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.319311    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:38:03.319563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.319502    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" podUID="feef718c-27e2-41d7-831d-68007b0ce1e5" containerName="maas-api" containerID="cri-o://7090556d3360e35af9ea1b737f0c02a2f49b26367c22020182a5a431611e636a" gracePeriod=30
Jul 07 15:38:03.345302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.345275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:03.523889 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.523857    2583 generic.go:356] "Generic (PLEG): container finished" podID="feef718c-27e2-41d7-831d-68007b0ce1e5" containerID="7090556d3360e35af9ea1b737f0c02a2f49b26367c22020182a5a431611e636a" exitCode=0
Jul 07 15:38:03.524080 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.523928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" event={"ID":"feef718c-27e2-41d7-831d-68007b0ce1e5","Type":"ContainerDied","Data":"7090556d3360e35af9ea1b737f0c02a2f49b26367c22020182a5a431611e636a"}
Jul 07 15:38:03.573372 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.573305    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:38:03.682887 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.682850    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") pod \"feef718c-27e2-41d7-831d-68007b0ce1e5\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") "
Jul 07 15:38:03.683346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.682915    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca\") pod \"feef718c-27e2-41d7-831d-68007b0ce1e5\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") "
Jul 07 15:38:03.683346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.682963    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r479p\" (UniqueName: \"kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p\") pod \"feef718c-27e2-41d7-831d-68007b0ce1e5\" (UID: \"feef718c-27e2-41d7-831d-68007b0ce1e5\") "
Jul 07 15:38:03.683425 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.683339    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "feef718c-27e2-41d7-831d-68007b0ce1e5" (UID: "feef718c-27e2-41d7-831d-68007b0ce1e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:38:03.685017 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.684988    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p" (OuterVolumeSpecName: "kube-api-access-r479p") pod "feef718c-27e2-41d7-831d-68007b0ce1e5" (UID: "feef718c-27e2-41d7-831d-68007b0ce1e5"). InnerVolumeSpecName "kube-api-access-r479p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:03.685017 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.684994    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "feef718c-27e2-41d7-831d-68007b0ce1e5" (UID: "feef718c-27e2-41d7-831d-68007b0ce1e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:38:03.783692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.783652    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feef718c-27e2-41d7-831d-68007b0ce1e5-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:38:03.783692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.783685    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feef718c-27e2-41d7-831d-68007b0ce1e5-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:38:03.783692 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:03.783695    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r479p\" (UniqueName: \"kubernetes.io/projected/feef718c-27e2-41d7-831d-68007b0ce1e5-kube-api-access-r479p\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:38:04.512295 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.512265    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:38:04.531185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.531156    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"
Jul 07 15:38:04.531349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.531187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh" event={"ID":"feef718c-27e2-41d7-831d-68007b0ce1e5","Type":"ContainerDied","Data":"163da7420330065dfed009c561f16c723b021749f47342f90f941acda21be085"}
Jul 07 15:38:04.531349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.531247    2583 scope.go:117] "RemoveContainer" containerID="7090556d3360e35af9ea1b737f0c02a2f49b26367c22020182a5a431611e636a"
Jul 07 15:38:04.563433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.563394    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:38:04.587161 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:04.587093    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-ad5677-6f4fd989cd-w7rmh"]
Jul 07 15:38:05.285617 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:05.285578    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feef718c-27e2-41d7-831d-68007b0ce1e5" path="/var/lib/kubelet/pods/feef718c-27e2-41d7-831d-68007b0ce1e5/volumes"
Jul 07 15:38:09.025522 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:09.025489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:09.097628 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:09.097592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:09.303463 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:09.303378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:09.564310 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:09.564213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:09.916965 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:09.916873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:10.301608 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:10.301570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:10.399948 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:10.399913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:10.507679 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:10.507643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:10.653149 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:10.653053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:13.898589 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:13.898532    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:38:16.169054 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:16.169011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:16.272982 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:16.272930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:16.487396 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:16.487299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:16.756839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:16.756742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:17.093494 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:17.093400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:17.463477 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:17.463425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:17.687758 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:17.687723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:20.951584 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:20.951528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:21.019498 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.019462    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:38:21.019983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.019950    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feef718c-27e2-41d7-831d-68007b0ce1e5" containerName="maas-api"
Jul 07 15:38:21.019983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.019979    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="feef718c-27e2-41d7-831d-68007b0ce1e5" containerName="maas-api"
Jul 07 15:38:21.020185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.020056    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="feef718c-27e2-41d7-831d-68007b0ce1e5" containerName="maas-api"
Jul 07 15:38:21.023150 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.023122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.025990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.025969    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-f09258-serving-cert\""
Jul 07 15:38:21.026739 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.026719    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:38:21.036334 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.036311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:38:21.053229 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.053201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:21.131927 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.131891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.132113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.131945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dss96\" (UniqueName: \"kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.132113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.132066    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.154139 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.154104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:21.232695 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.232598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dss96\" (UniqueName: \"kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.232695 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.232679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.232922 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.232731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.233366 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.233345    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.235178 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.235155    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.242456 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.242434    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dss96\" (UniqueName: \"kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96\") pod \"maas-api-e2e-shared-a-f09258-97567c8bf-vt259\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") " pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.250153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.250087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:21.336257 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.336223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:21.475622 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.475596    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:38:21.477408 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:38:21.477380    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a31b87d_278b_4b31_8100_c71be1b1abbf.slice/crio-af3ca64053931de160ad8567a7a56f9149019defffc36f9f0390db006597efb0 WatchSource:0}: Error finding container af3ca64053931de160ad8567a7a56f9149019defffc36f9f0390db006597efb0: Status 404 returned error can't find the container with id af3ca64053931de160ad8567a7a56f9149019defffc36f9f0390db006597efb0
Jul 07 15:38:21.620271 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.620180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:21.633203 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.633171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" event={"ID":"5a31b87d-278b-4b31-8100-c71be1b1abbf","Type":"ContainerStarted","Data":"af3ca64053931de160ad8567a7a56f9149019defffc36f9f0390db006597efb0"}
Jul 07 15:38:21.719375 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:21.719344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:22.640252 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:22.640208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" event={"ID":"5a31b87d-278b-4b31-8100-c71be1b1abbf","Type":"ContainerStarted","Data":"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"}
Jul 07 15:38:22.640734 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:22.640270    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:22.661521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:22.661466    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" podStartSLOduration=2.3326091939999998 podStartE2EDuration="2.661449317s" totalImagesPullingTime="328.840123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:22.659314815 +0000 UTC m=+2259.925059789" watchObservedRunningTime="2026-07-07 15:38:22.661449317 +0000 UTC m=+2259.927194292"
Jul 07 15:38:25.473550 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:25.473480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:25.597147 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:25.597113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:38:25.825099 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:25.825004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:26.193858 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:26.193812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:26.388911 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:26.388874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:28.652096 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:28.652070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:38:28.971302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:28.971252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:29.556315 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:29.556281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:29.660127 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:29.660094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:29.758816 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:29.758772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:33.973580 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:33.973517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:34.307199 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:34.307111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:38:41.896418 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.896374    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:38:41.900294 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.900270    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:41.906502 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.906477    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"auth-test-model-f09258-kserve-self-signed-certs\""
Jul 07 15:38:41.907667 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.907648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"kube-root-ca.crt\""
Jul 07 15:38:41.907768 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.907647    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"openshift-service-ca.crt\""
Jul 07 15:38:41.907768 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.907707    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"default-dockercfg-qdlx9\""
Jul 07 15:38:41.916406 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.916382    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:38:41.938298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:41.938260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:42.018030 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.017991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.018211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.018057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.018211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.018106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.018211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.018167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.018211 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.018197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxnw\" (UniqueName: \"kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.018354 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.018242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.118867 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.118827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.118888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.118906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.118929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.118954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxnw\" (UniqueName: \"kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119051 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.119005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119313 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.119292    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119404 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.119319    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.119404 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.119356    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.121286 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.121258    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.121467 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.121442    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.128081 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.128058    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxnw\" (UniqueName: \"kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw\") pod \"auth-test-model-f09258-kserve-bc89988cf-rflq7\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") " pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.209888 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.209853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:42.353901 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.353872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:38:42.355592 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:38:42.355566    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ad1e82e_7d04_4bb2_aa22_b8e0a4b3d2b5.slice/crio-2fdc1c003199db58c30525c86e76a3cbe4a6a9c20531f92e66c0962853114462 WatchSource:0}: Error finding container 2fdc1c003199db58c30525c86e76a3cbe4a6a9c20531f92e66c0962853114462: Status 404 returned error can't find the container with id 2fdc1c003199db58c30525c86e76a3cbe4a6a9c20531f92e66c0962853114462
Jul 07 15:38:42.551157 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.551063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:42.651457 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.651419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:42.750119 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.750085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" event={"ID":"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5","Type":"ContainerStarted","Data":"92f74c25e57b3a5e8973d0b2b8f8b1b0cebb10c6fcee179092d7e68743f54605"}
Jul 07 15:38:42.750287 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.750128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" event={"ID":"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5","Type":"ContainerStarted","Data":"2fdc1c003199db58c30525c86e76a3cbe4a6a9c20531f92e66c0962853114462"}
Jul 07 15:38:42.769824 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:42.769775    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" podStartSLOduration=1.769761338 podStartE2EDuration="1.769761338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:42.767663244 +0000 UTC m=+2280.033408232" watchObservedRunningTime="2026-07-07 15:38:42.769761338 +0000 UTC m=+2280.035506313"
Jul 07 15:38:47.411030 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:47.410994    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:38:48.996113 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:48.996072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:50.520949 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:50.520914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:50.588972 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:50.588936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:52.210895 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:52.210860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:52.211368 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:52.210909    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:52.223558 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:52.223511    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:38:52.813858 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:38:52.813827    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:39:13.054427 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:39:13.054374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:16.796337 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:39:16.796298    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:39:35.115346 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:39:35.115258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:39:52.497717 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:39:52.497679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:40:06.693795 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:06.693760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:40:12.366470 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:12.366416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:24.195481 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:24.195441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:40:35.668778 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:35.668738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:41.695652 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:41.695610    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:40:59.200269 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:40:59.200229    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:41:12.409441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:12.409408    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:41:12.454084 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:12.454047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:13.398977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:13.398939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:16.391790 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:16.391751    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:41:19.972804 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:19.972768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:21.836698 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:21.836659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:27.430359 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.430312    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" podUID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" containerName="main" containerID="cri-o://92f74c25e57b3a5e8973d0b2b8f8b1b0cebb10c6fcee179092d7e68743f54605" gracePeriod=45
Jul 07 15:41:27.632827 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.632797    2583 generic.go:356] "Generic (PLEG): container finished" podID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" containerID="92f74c25e57b3a5e8973d0b2b8f8b1b0cebb10c6fcee179092d7e68743f54605" exitCode=0
Jul 07 15:41:27.632989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.632871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" event={"ID":"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5","Type":"ContainerDied","Data":"92f74c25e57b3a5e8973d0b2b8f8b1b0cebb10c6fcee179092d7e68743f54605"}
Jul 07 15:41:27.679516 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.679489    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:41:27.865409 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865313    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865593 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865413    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865593 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mxnw\" (UniqueName: \"kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865593 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865496    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865593 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865593 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache\") pod \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\" (UID: \"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5\") "
Jul 07 15:41:27.865889 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865829    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:27.865889 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865847    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home" (OuterVolumeSpecName: "home") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:27.865974 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.865912    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:27.867839 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.867816    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm" (OuterVolumeSpecName: "dshm") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:27.867956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.867837    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw" (OuterVolumeSpecName: "kube-api-access-4mxnw") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "kube-api-access-4mxnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:41:27.867956 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.867848    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" (UID: "0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:41:27.967102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967059    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-dshm\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:27.967102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967095    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxnw\" (UniqueName: \"kubernetes.io/projected/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-kube-api-access-4mxnw\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:27.967102 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967109    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tmp-dir\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:27.967349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967121    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-home\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:27.967349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967132    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-model-cache\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:27.967349 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:27.967142    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5-tls-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.639900 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:28.639858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7" event={"ID":"0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5","Type":"ContainerDied","Data":"2fdc1c003199db58c30525c86e76a3cbe4a6a9c20531f92e66c0962853114462"}
Jul 07 15:41:28.640371 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:28.639914    2583 scope.go:117] "RemoveContainer" containerID="92f74c25e57b3a5e8973d0b2b8f8b1b0cebb10c6fcee179092d7e68743f54605"
Jul 07 15:41:28.640371 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:28.639876    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"
Jul 07 15:41:28.662911 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:28.662878    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:41:28.664938 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:28.664914    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/auth-test-model-f09258-kserve-bc89988cf-rflq7"]
Jul 07 15:41:29.286015 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:29.285975    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" path="/var/lib/kubelet/pods/0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5/volumes"
Jul 07 15:41:31.198596 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:31.198559    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:41:57.310295 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.310264    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:41:57.310685 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.310622    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" containerName="main"
Jul 07 15:41:57.310685 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.310633    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" containerName="main"
Jul 07 15:41:57.310757 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.310707    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ad1e82e-7d04-4bb2-aa22-b8e0a4b3d2b5" containerName="main"
Jul 07 15:41:57.313791 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.313774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.316928 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.316900    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"sub-test-model-c9c5ee-kserve-self-signed-certs\""
Jul 07 15:41:57.317057 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.316901    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"openshift-service-ca.crt\""
Jul 07 15:41:57.317057 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.316901    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"default-dockercfg-dsfxh\""
Jul 07 15:41:57.317883 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.317866    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"kube-root-ca.crt\""
Jul 07 15:41:57.326316 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.326293    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:41:57.339329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.339296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:57.415554 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.415721 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g97kq\" (UniqueName: \"kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.415721 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.415721 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415633    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.415834 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.415834 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.415772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517093 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g97kq\" (UniqueName: \"kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517614 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517614 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517579    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.517727 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.517690    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.519445 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.519427    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.519730 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.519714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.525751 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.525730    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g97kq\" (UniqueName: \"kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq\") pod \"sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") " pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.622471 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.622377    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:41:57.767548 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.767505    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:41:57.770250 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:41:57.770212    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6148418_8d5f_40c8_9d6d_54f1f9ca8785.slice/crio-5c5e7b1a85f677b558cf5d9c2be1f291a4d45374f6a26e583cd408c71165f5f0 WatchSource:0}: Error finding container 5c5e7b1a85f677b558cf5d9c2be1f291a4d45374f6a26e583cd408c71165f5f0: Status 404 returned error can't find the container with id 5c5e7b1a85f677b558cf5d9c2be1f291a4d45374f6a26e583cd408c71165f5f0
Jul 07 15:41:57.797823 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:57.797784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" event={"ID":"f6148418-8d5f-40c8-9d6d-54f1f9ca8785","Type":"ContainerStarted","Data":"5c5e7b1a85f677b558cf5d9c2be1f291a4d45374f6a26e583cd408c71165f5f0"}
Jul 07 15:41:58.804856 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:58.804816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" event={"ID":"f6148418-8d5f-40c8-9d6d-54f1f9ca8785","Type":"ContainerStarted","Data":"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"}
Jul 07 15:41:58.827302 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:41:58.827245    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" podStartSLOduration=1.827229422 podStartE2EDuration="1.827229422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:58.823774143 +0000 UTC m=+2476.089519118" watchObservedRunningTime="2026-07-07 15:41:58.827229422 +0000 UTC m=+2476.092974397"
Jul 07 15:42:01.800315 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:01.800272    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:42:07.622647 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:07.622594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:07.622647 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:07.622660    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:07.634925 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:07.634892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:07.864583 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:07.864534    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:16.699088 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:16.699049    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:42:34.904290 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:34.904210    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:42:40.353353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:40.353312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:42:41.306171 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:41.306138    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:42:41.332619 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:41.332529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:42:47.219365 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.219332    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:42:47.222995 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.222977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.228409 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.228371    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"kube-root-ca.crt\""
Jul 07 15:42:47.228409 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.228371    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"rate-test-model-f09258-kserve-self-signed-certs\""
Jul 07 15:42:47.228636 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.228480    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"default-dockercfg-qdlx9\""
Jul 07 15:42:47.228701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.228653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"openshift-service-ca.crt\""
Jul 07 15:42:47.239024 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.238998    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:42:47.251850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.251818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.251850 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.251855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.252131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.251883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g86dz\" (UniqueName: \"kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.252131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.251950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.252131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.252016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.252131 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.252047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.252991 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.252964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:42:47.352991 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.352953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353196 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g86dz\" (UniqueName: \"kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353475 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353435    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353563 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353482    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.353611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.353566    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.355446 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.355416    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.355747 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.355716    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.362440 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.362416    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g86dz\" (UniqueName: \"kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz\") pod \"rate-test-model-f09258-kserve-7bdcb969f9-tqk2j\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") " pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.532814 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.532723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:47.671286 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:47.671260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:42:47.673261 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:42:47.673237    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a2f0181_3fbc_4ba6_afab_a84283ecd238.slice/crio-49a01f8fe53c88d2dd3800cd9c5e14191261982034d2f921e88823803d94dfe4 WatchSource:0}: Error finding container 49a01f8fe53c88d2dd3800cd9c5e14191261982034d2f921e88823803d94dfe4: Status 404 returned error can't find the container with id 49a01f8fe53c88d2dd3800cd9c5e14191261982034d2f921e88823803d94dfe4
Jul 07 15:42:48.077731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:48.077693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" event={"ID":"3a2f0181-3fbc-4ba6-afab-a84283ecd238","Type":"ContainerStarted","Data":"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"}
Jul 07 15:42:48.077731 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:48.077737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" event={"ID":"3a2f0181-3fbc-4ba6-afab-a84283ecd238","Type":"ContainerStarted","Data":"49a01f8fe53c88d2dd3800cd9c5e14191261982034d2f921e88823803d94dfe4"}
Jul 07 15:42:48.099468 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:48.099414    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" podStartSLOduration=1.099396861 podStartE2EDuration="1.099396861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:48.097330667 +0000 UTC m=+2525.363075668" watchObservedRunningTime="2026-07-07 15:42:48.099396861 +0000 UTC m=+2525.365141825"
Jul 07 15:42:52.999610 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:52.999560    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:42:56.326579 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.326492    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" podUID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" containerName="main" containerID="cri-o://d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54" gracePeriod=45
Jul 07 15:42:56.572318 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.572291    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:56.638983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.638902    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.638983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.638950    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.638983 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.638982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g97kq\" (UniqueName: \"kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.639214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639027    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.639214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639044    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.639214 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache\") pod \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\" (UID: \"f6148418-8d5f-40c8-9d6d-54f1f9ca8785\") "
Jul 07 15:42:56.639372 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639238    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home" (OuterVolumeSpecName: "home") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:56.639372 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639317    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:56.639479 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639375    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-home\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.639560 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.639478    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:56.641230 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.641202    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm" (OuterVolumeSpecName: "dshm") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:56.641345 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.641238    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq" (OuterVolumeSpecName: "kube-api-access-g97kq") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "kube-api-access-g97kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:42:56.641345 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.641242    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6148418-8d5f-40c8-9d6d-54f1f9ca8785" (UID: "f6148418-8d5f-40c8-9d6d-54f1f9ca8785"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:42:56.740298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.740262    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tmp-dir\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.740298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.740289    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-dshm\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.740298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.740298    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-model-cache\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.740298 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.740308    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-tls-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.740604 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:56.740316    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g97kq\" (UniqueName: \"kubernetes.io/projected/f6148418-8d5f-40c8-9d6d-54f1f9ca8785-kube-api-access-g97kq\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:42:57.127621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.127584    2583 generic.go:356] "Generic (PLEG): container finished" podID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" containerID="d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54" exitCode=0
Jul 07 15:42:57.127819 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.127631    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"
Jul 07 15:42:57.127819 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.127669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" event={"ID":"f6148418-8d5f-40c8-9d6d-54f1f9ca8785","Type":"ContainerDied","Data":"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"}
Jul 07 15:42:57.127819 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.127714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6" event={"ID":"f6148418-8d5f-40c8-9d6d-54f1f9ca8785","Type":"ContainerDied","Data":"5c5e7b1a85f677b558cf5d9c2be1f291a4d45374f6a26e583cd408c71165f5f0"}
Jul 07 15:42:57.127819 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.127731    2583 scope.go:117] "RemoveContainer" containerID="d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"
Jul 07 15:42:57.137239 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.137221    2583 scope.go:117] "RemoveContainer" containerID="d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"
Jul 07 15:42:57.137503 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:42:57.137485    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54\": container with ID starting with d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54 not found: ID does not exist" containerID="d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"
Jul 07 15:42:57.137588 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.137512    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54"} err="failed to get container status \"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54\": rpc error: code = NotFound desc = could not find container \"d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54\": container with ID starting with d10b0298825dab4245e0d17d63e3dbeaae51c90317d1754ed11701a89d590d54 not found: ID does not exist"
Jul 07 15:42:57.152792 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.152767    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:42:57.160122 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.160102    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/sub-test-model-c9c5ee-kserve-5d9fb9f68c-vdws6"]
Jul 07 15:42:57.284004 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.283967    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" path="/var/lib/kubelet/pods/f6148418-8d5f-40c8-9d6d-54f1f9ca8785/volumes"
Jul 07 15:42:57.533164 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.533128    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:57.533621 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.533193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:57.545915 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:57.545885    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:42:58.144551 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:42:58.144515    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:43:01.396428 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:01.396390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:02.949348 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:02.949314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:15.716493 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:15.716457    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:19.712526 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:19.712477    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:43:34.007444 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:34.007404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:43:43.388160 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:43.388103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:43.489343 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:43.489310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:51.143095 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:51.143055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:51.252929 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:51.252889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:54.905647 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:43:54.905610    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:44:02.199724 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:02.199688    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:44:02.214056 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:02.214017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:02.951406 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:02.951362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:04.157092 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.157058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:04.527015 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.526979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:04.626689 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.626608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:04.727329 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.727294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:04.817528 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.817443    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:44:04.817697 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.817670    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" podUID="5a31b87d-278b-4b31-8100-c71be1b1abbf" containerName="maas-api" containerID="cri-o://535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53" gracePeriod=30
Jul 07 15:44:04.851338 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:04.851296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:05.067845 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.067786    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:44:05.156353 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.156325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dss96\" (UniqueName: \"kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96\") pod \"5a31b87d-278b-4b31-8100-c71be1b1abbf\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") "
Jul 07 15:44:05.156553 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.156407    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls\") pod \"5a31b87d-278b-4b31-8100-c71be1b1abbf\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") "
Jul 07 15:44:05.156553 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.156458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca\") pod \"5a31b87d-278b-4b31-8100-c71be1b1abbf\" (UID: \"5a31b87d-278b-4b31-8100-c71be1b1abbf\") "
Jul 07 15:44:05.156823 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.156797    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a31b87d-278b-4b31-8100-c71be1b1abbf" (UID: "5a31b87d-278b-4b31-8100-c71be1b1abbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:05.158498 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.158477    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96" (OuterVolumeSpecName: "kube-api-access-dss96") pod "5a31b87d-278b-4b31-8100-c71be1b1abbf" (UID: "5a31b87d-278b-4b31-8100-c71be1b1abbf"). InnerVolumeSpecName "kube-api-access-dss96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:05.158782 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.158503    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a31b87d-278b-4b31-8100-c71be1b1abbf" (UID: "5a31b87d-278b-4b31-8100-c71be1b1abbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:05.257952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.257921    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a31b87d-278b-4b31-8100-c71be1b1abbf-maas-api-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:05.257952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.257951    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a31b87d-278b-4b31-8100-c71be1b1abbf-openshift-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:05.257952 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.257961    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dss96\" (UniqueName: \"kubernetes.io/projected/5a31b87d-278b-4b31-8100-c71be1b1abbf-kube-api-access-dss96\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:05.500895 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.500859    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a31b87d-278b-4b31-8100-c71be1b1abbf" containerID="535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53" exitCode=0
Jul 07 15:44:05.501088 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.500912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"
Jul 07 15:44:05.501088 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.500958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" event={"ID":"5a31b87d-278b-4b31-8100-c71be1b1abbf","Type":"ContainerDied","Data":"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"}
Jul 07 15:44:05.501088 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.501010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259" event={"ID":"5a31b87d-278b-4b31-8100-c71be1b1abbf","Type":"ContainerDied","Data":"af3ca64053931de160ad8567a7a56f9149019defffc36f9f0390db006597efb0"}
Jul 07 15:44:05.501088 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.501042    2583 scope.go:117] "RemoveContainer" containerID="535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"
Jul 07 15:44:05.510080 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.510063    2583 scope.go:117] "RemoveContainer" containerID="535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"
Jul 07 15:44:05.510330 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:44:05.510312    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53\": container with ID starting with 535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53 not found: ID does not exist" containerID="535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"
Jul 07 15:44:05.510408 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.510339    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53"} err="failed to get container status \"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53\": rpc error: code = NotFound desc = could not find container \"535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53\": container with ID starting with 535f02848ca6483477cdebfbb3a6158b3e0f78bce4e4635b44d14f719761dd53 not found: ID does not exist"
Jul 07 15:44:05.519656 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.519633    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:44:05.523962 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:05.523941    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f09258-97567c8bf-vt259"]
Jul 07 15:44:06.923296 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:06.923250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:06.981264 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:06.981226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:07.284420 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:07.284337    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a31b87d-278b-4b31-8100-c71be1b1abbf" path="/var/lib/kubelet/pods/5a31b87d-278b-4b31-8100-c71be1b1abbf/volumes"
Jul 07 15:44:08.896953 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:08.896916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:44:09.598516 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:09.598477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:17.220701 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.220653    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" podUID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" containerName="main" containerID="cri-o://c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2" gracePeriod=45
Jul 07 15:44:17.479509 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.479443    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:44:17.564476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564475    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564511    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g86dz\" (UniqueName: \"kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564558    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564728 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564672    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home\") pod \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\" (UID: \"3a2f0181-3fbc-4ba6-afab-a84283ecd238\") "
Jul 07 15:44:17.564990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564767    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:17.564990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.564939    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:17.565112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.565083    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home" (OuterVolumeSpecName: "home") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:17.565112 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.565091    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tmp-dir\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:17.565197 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.565129    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-model-cache\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:17.566729 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.566702    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm" (OuterVolumeSpecName: "dshm") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:17.566861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.566767    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:17.567084 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.567068    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz" (OuterVolumeSpecName: "kube-api-access-g86dz") pod "3a2f0181-3fbc-4ba6-afab-a84283ecd238" (UID: "3a2f0181-3fbc-4ba6-afab-a84283ecd238"). InnerVolumeSpecName "kube-api-access-g86dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:17.571400 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.571371    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" containerID="c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2" exitCode=0
Jul 07 15:44:17.571519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.571417    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"
Jul 07 15:44:17.571519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.571457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" event={"ID":"3a2f0181-3fbc-4ba6-afab-a84283ecd238","Type":"ContainerDied","Data":"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"}
Jul 07 15:44:17.571519 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.571505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j" event={"ID":"3a2f0181-3fbc-4ba6-afab-a84283ecd238","Type":"ContainerDied","Data":"49a01f8fe53c88d2dd3800cd9c5e14191261982034d2f921e88823803d94dfe4"}
Jul 07 15:44:17.571726 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.571523    2583 scope.go:117] "RemoveContainer" containerID="c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"
Jul 07 15:44:17.585809 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.585792    2583 scope.go:117] "RemoveContainer" containerID="c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"
Jul 07 15:44:17.586094 ip-10-0-131-27 kubenswrapper[2583]: E0707 15:44:17.586075    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2\": container with ID starting with c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2 not found: ID does not exist" containerID="c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"
Jul 07 15:44:17.586153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.586103    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2"} err="failed to get container status \"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2\": rpc error: code = NotFound desc = could not find container \"c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2\": container with ID starting with c937b1eeab4eec09654e4d688a0b95f4b4ed8542728bfcac8d93db7f9913f8a2 not found: ID does not exist"
Jul 07 15:44:17.598643 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.598619    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:44:17.604104 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.604084    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/rate-test-model-f09258-kserve-7bdcb969f9-tqk2j"]
Jul 07 15:44:17.666274 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.666237    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-home\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:17.666274 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.666266    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2f0181-3fbc-4ba6-afab-a84283ecd238-dshm\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:17.666274 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.666280    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g86dz\" (UniqueName: \"kubernetes.io/projected/3a2f0181-3fbc-4ba6-afab-a84283ecd238-kube-api-access-g86dz\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:17.666515 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:17.666293    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2f0181-3fbc-4ba6-afab-a84283ecd238-tls-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\""
Jul 07 15:44:19.291441 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:19.291398    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" path="/var/lib/kubelet/pods/3a2f0181-3fbc-4ba6-afab-a84283ecd238/volumes"
Jul 07 15:44:22.793356 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:22.793310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:22.894835 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:22.894803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:46.780977 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:46.780938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:47.131496 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:47.131395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:47.346124 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:47.346091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:47.602177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:47.602141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:48.063683 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:48.063647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:48.164134 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:48.164099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:48.263895 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:48.263858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:48.429308 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:48.429276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:51.500704 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:51.500671    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-srsbk"]
Jul 07 15:44:53.803680 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:53.803639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:53.870184 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:53.870147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:54.144200 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:54.144108    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:54.347241 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:54.347203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:54.801877 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:44:54.801844    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f6c7647-chkt7_fea04d64-a25d-4f2f-842e-2b6689007df2/authorino/0.log"
Jul 07 15:45:00.896663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:00.896633    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-78lrl_d335a360-aad1-41f2-918e-aa1b4c52ac96/copy-manifests/0.log"
Jul 07 15:45:00.903872 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:00.903839    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-78lrl_d335a360-aad1-41f2-918e-aa1b4c52ac96/manager/0.log"
Jul 07 15:45:02.190255 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.190221    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/util/0.log"
Jul 07 15:45:02.197592 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.197559    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/pull/0.log"
Jul 07 15:45:02.204148 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.204126    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/extract/0.log"
Jul 07 15:45:02.328476 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.328448    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/pull/0.log"
Jul 07 15:45:02.335852 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.335829    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/extract/0.log"
Jul 07 15:45:02.342427 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.342407    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/util/0.log"
Jul 07 15:45:02.466284 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.466186    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/util/0.log"
Jul 07 15:45:02.473384 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.473361    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/pull/0.log"
Jul 07 15:45:02.482042 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.482014    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/extract/0.log"
Jul 07 15:45:02.606698 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.606665    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/util/0.log"
Jul 07 15:45:02.613572 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.613530    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/pull/0.log"
Jul 07 15:45:02.621923 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.621901    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/extract/0.log"
Jul 07 15:45:02.756759 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:02.756674    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f6c7647-chkt7_fea04d64-a25d-4f2f-842e-2b6689007df2/authorino/0.log"
Jul 07 15:45:03.128361 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:03.128281    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pggz7_11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b/kuadrant-console-plugin/0.log"
Jul 07 15:45:03.537626 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:03.537590    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-srsbk_20f99bbd-56fe-4fcd-88e2-4d79f955fbf9/limitador/0.log"
Jul 07 15:45:04.292071 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:04.292039    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-f9nml_8e0e6e00-68ab-4279-b0a5-852c46cb351f/kube-auth-proxy/0.log"
Jul 07 15:45:10.486205 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486169    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8xvs/must-gather-8wptb"]
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486548    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" containerName="main"
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486565    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" containerName="main"
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486589    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a31b87d-278b-4b31-8100-c71be1b1abbf" containerName="maas-api"
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486595    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a31b87d-278b-4b31-8100-c71be1b1abbf" containerName="maas-api"
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486602    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" containerName="main"
Jul 07 15:45:10.486611 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486610    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" containerName="main"
Jul 07 15:45:10.486813 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486672    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f0181-3fbc-4ba6-afab-a84283ecd238" containerName="main"
Jul 07 15:45:10.486813 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486680    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6148418-8d5f-40c8-9d6d-54f1f9ca8785" containerName="main"
Jul 07 15:45:10.486813 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.486687    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a31b87d-278b-4b31-8100-c71be1b1abbf" containerName="maas-api"
Jul 07 15:45:10.490016 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.489999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.492990 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.492963    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8xvs\"/\"kube-root-ca.crt\""
Jul 07 15:45:10.493153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.492963    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8xvs\"/\"default-dockercfg-lz587\""
Jul 07 15:45:10.493153 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.493021    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8xvs\"/\"openshift-service-ca.crt\""
Jul 07 15:45:10.498331 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.498306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/must-gather-8wptb"]
Jul 07 15:45:10.516325 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.516290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:45:10.518296 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.518276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a238fa78-c7b0-404e-a8b2-c954e4a02546-must-gather-output\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.518400 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.518330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8qnv\" (UniqueName: \"kubernetes.io/projected/a238fa78-c7b0-404e-a8b2-c954e4a02546-kube-api-access-p8qnv\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.610237 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.610199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:45:10.619383 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.619355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a238fa78-c7b0-404e-a8b2-c954e4a02546-must-gather-output\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.619553 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.619517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8qnv\" (UniqueName: \"kubernetes.io/projected/a238fa78-c7b0-404e-a8b2-c954e4a02546-kube-api-access-p8qnv\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.619750 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.619731    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a238fa78-c7b0-404e-a8b2-c954e4a02546-must-gather-output\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.628639 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.628620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8qnv\" (UniqueName: \"kubernetes.io/projected/a238fa78-c7b0-404e-a8b2-c954e4a02546-kube-api-access-p8qnv\") pod \"must-gather-8wptb\" (UID: \"a238fa78-c7b0-404e-a8b2-c954e4a02546\") " pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.801049 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.800927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/must-gather-8wptb"
Jul 07 15:45:10.935807 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.935779    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/must-gather-8wptb"]
Jul 07 15:45:10.937510 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:45:10.937486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda238fa78_c7b0_404e_a8b2_c954e4a02546.slice/crio-7df8fa952858c9f71d47a461e3f1a388d77e4837b4112a980602bbb1084e5484 WatchSource:0}: Error finding container 7df8fa952858c9f71d47a461e3f1a388d77e4837b4112a980602bbb1084e5484: Status 404 returned error can't find the container with id 7df8fa952858c9f71d47a461e3f1a388d77e4837b4112a980602bbb1084e5484
Jul 07 15:45:10.939550 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:10.939519    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:45:11.863464 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:11.863362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/must-gather-8wptb" event={"ID":"a238fa78-c7b0-404e-a8b2-c954e4a02546","Type":"ContainerStarted","Data":"0d8e3dc704cf67a505255cb9c1f914f08399278e7c5b0fde620ae69d3cf60417"}
Jul 07 15:45:11.863464 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:11.863419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/must-gather-8wptb" event={"ID":"a238fa78-c7b0-404e-a8b2-c954e4a02546","Type":"ContainerStarted","Data":"4daf88fe5fb2d2800009b61bc431ed3af742215a887f04b8c08f618be28a721a"}
Jul 07 15:45:11.863464 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:11.863435    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/must-gather-8wptb" event={"ID":"a238fa78-c7b0-404e-a8b2-c954e4a02546","Type":"ContainerStarted","Data":"7df8fa952858c9f71d47a461e3f1a388d77e4837b4112a980602bbb1084e5484"}
Jul 07 15:45:11.882936 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:11.882876    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d8xvs/must-gather-8wptb" podStartSLOduration=1.268524415 podStartE2EDuration="1.882859335s" totalImagesPullingTime="614.33492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:11.880266834 +0000 UTC m=+2669.146011809" watchObservedRunningTime="2026-07-07 15:45:11.882859335 +0000 UTC m=+2669.148604309"
Jul 07 15:45:13.202559 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:13.202512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r8zc9_119c7224-9d6a-44de-af5c-fd139489779f/global-pull-secret-syncer/0.log"
Jul 07 15:45:13.260154 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:13.260116    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log"
Jul 07 15:45:13.377777 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:13.377740    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-27.ec2.internal_f5f590796caafd9ede31a5a0b1060392/haproxy/0.log"
Jul 07 15:45:15.860748 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:15.860703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:45:15.925252 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:15.925213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024
Jul 07 15:45:17.222355 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.222316    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/extract/0.log"
Jul 07 15:45:17.255770 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.255733    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/util/0.log"
Jul 07 15:45:17.296724 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.296691    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75969ngk_dd986cf4-cd01-4d09-95e9-1c1ffb20c680/pull/0.log"
Jul 07 15:45:17.341963 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.341931    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/extract/0.log"
Jul 07 15:45:17.368106 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.368068    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/util/0.log"
Jul 07 15:45:17.392172 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.392139    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sq25l_56fea01e-bfcc-45e7-b055-c26302bee23d/pull/0.log"
Jul 07 15:45:17.430504 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.430473    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/extract/0.log"
Jul 07 15:45:17.451916 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.451887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/util/0.log"
Jul 07 15:45:17.476033 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.475947    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734wpgj_f4ec6ce4-f476-4594-ab61-57c273d16e8c/pull/0.log"
Jul 07 15:45:17.505078 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.505046    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/extract/0.log"
Jul 07 15:45:17.541620 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.541592    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/util/0.log"
Jul 07 15:45:17.567419 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:17.567391    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m6mbk_861763d6-a2d1-4bfb-9e1d-41c28e6a8e11/pull/0.log"
Jul 07 15:45:18.029722 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:18.029694    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548f6c7647-chkt7_fea04d64-a25d-4f2f-842e-2b6689007df2/authorino/0.log"
Jul 07 15:45:18.123029 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:18.123001    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pggz7_11ab4bd1-bf02-41d6-87ce-d5e5b6760b8b/kuadrant-console-plugin/0.log"
Jul 07 15:45:18.299863 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:18.299769    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-srsbk_20f99bbd-56fe-4fcd-88e2-4d79f955fbf9/limitador/0.log"
Jul 07 15:45:19.926473 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:19.926441    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/alertmanager/0.log"
Jul 07 15:45:19.953765 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:19.953737    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/config-reloader/0.log"
Jul 07 15:45:19.979662 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:19.979631    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/kube-rbac-proxy-web/0.log"
Jul 07 15:45:20.005964 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.005927    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/kube-rbac-proxy/0.log"
Jul 07 15:45:20.035760 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.035729    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/kube-rbac-proxy-metric/0.log"
Jul 07 15:45:20.059745 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.059716    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/prom-label-proxy/0.log"
Jul 07 15:45:20.082654 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.082621    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c5a96ca-ef7d-46a7-bdcf-9a2d4ada3894/init-config-reloader/0.log"
Jul 07 15:45:20.271605 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.271503    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rqtbj_921c120b-1b27-44c1-a29e-7b2989fb3a51/monitoring-plugin/0.log"
Jul 07 15:45:20.304289 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.304255    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bl2nc_bb8507a6-08f8-4e4c-b4ca-fa09e035a841/node-exporter/0.log"
Jul 07 15:45:20.340176 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.340131    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bl2nc_bb8507a6-08f8-4e4c-b4ca-fa09e035a841/kube-rbac-proxy/0.log"
Jul 07 15:45:20.365170 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.365135    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bl2nc_bb8507a6-08f8-4e4c-b4ca-fa09e035a841/init-textfile/0.log"
Jul 07 15:45:20.551663 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.550335    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2q8dc_251fe446-f56f-44de-82c9-18613497c473/kube-rbac-proxy-main/0.log"
Jul 07 15:45:20.587651 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.587600    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2q8dc_251fe446-f56f-44de-82c9-18613497c473/kube-rbac-proxy-self/0.log"
Jul 07 15:45:20.614068 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.614020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2q8dc_251fe446-f56f-44de-82c9-18613497c473/openshift-state-metrics/0.log"
Jul 07 15:45:20.819616 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.819458    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-hmzkn_3f10802a-cc5d-48a9-be88-5be1668d1786/prometheus-operator/0.log"
Jul 07 15:45:20.842520 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.842486    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-hmzkn_3f10802a-cc5d-48a9-be88-5be1668d1786/kube-rbac-proxy/0.log"
Jul 07 15:45:20.872427 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.872393    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-7kmbk_d952a4f1-e124-48df-8c5c-6f8b6b14c810/prometheus-operator-admission-webhook/0.log"
Jul 07 15:45:20.907883 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.907850    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f68bcff4-lvwt2_54a674f8-6368-4078-b08f-a08a95f27aca/telemeter-client/0.log"
Jul 07 15:45:20.933799 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.933765    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f68bcff4-lvwt2_54a674f8-6368-4078-b08f-a08a95f27aca/reload/0.log"
Jul 07 15:45:20.957909 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:20.957874    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f68bcff4-lvwt2_54a674f8-6368-4078-b08f-a08a95f27aca/kube-rbac-proxy/0.log"
Jul 07 15:45:23.725878 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:23.725844    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd67cd9d8-sdxmd_203b9324-3b69-409a-8368-cfca71930e46/console/0.log"
Jul 07 15:45:24.007978 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.007898    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"]
Jul 07 15:45:24.015866 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.015834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.029226 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.029152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"]
Jul 07 15:45:24.074810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.073731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxk7s\" (UniqueName: \"kubernetes.io/projected/c45281d9-bcd6-459a-a288-d2347e36c227-kube-api-access-pxk7s\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.074810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.073809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-proc\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.074810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.073866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-podres\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.074810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.073927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-lib-modules\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.074810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.074014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-sys\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175259 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxk7s\" (UniqueName: \"kubernetes.io/projected/c45281d9-bcd6-459a-a288-d2347e36c227-kube-api-access-pxk7s\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-proc\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-podres\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-lib-modules\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-sys\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175433 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175411    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-proc\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-sys\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175493    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-podres\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.175699 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.175582    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c45281d9-bcd6-459a-a288-d2347e36c227-lib-modules\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.186526 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.186484    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxk7s\" (UniqueName: \"kubernetes.io/projected/c45281d9-bcd6-459a-a288-d2347e36c227-kube-api-access-pxk7s\") pod \"perf-node-gather-daemonset-qzhtp\" (UID: \"c45281d9-bcd6-459a-a288-d2347e36c227\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.331032 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.330942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:24.433066 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.433023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-jqb4c_480ef445-fa62-424c-a934-94fb3345835b/volume-data-source-validator/0.log"
Jul 07 15:45:24.509941 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:24.509905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"]
Jul 07 15:45:24.511950 ip-10-0-131-27 kubenswrapper[2583]: W0707 15:45:24.511925    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc45281d9_bcd6_459a_a288_d2347e36c227.slice/crio-0a1e48da3679389e83a74dce2facacc7d62ecedc9fdbb9ca87529d4a62d4f6c5 WatchSource:0}: Error finding container 0a1e48da3679389e83a74dce2facacc7d62ecedc9fdbb9ca87529d4a62d4f6c5: Status 404 returned error can't find the container with id 0a1e48da3679389e83a74dce2facacc7d62ecedc9fdbb9ca87529d4a62d4f6c5
Jul 07 15:45:25.000810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.000458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp" event={"ID":"c45281d9-bcd6-459a-a288-d2347e36c227","Type":"ContainerStarted","Data":"5259c99448b8b63640081434dc10e34fee3f56e7d8f47feb3f0da7e46ee526e3"}
Jul 07 15:45:25.000810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.000532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp" event={"ID":"c45281d9-bcd6-459a-a288-d2347e36c227","Type":"ContainerStarted","Data":"0a1e48da3679389e83a74dce2facacc7d62ecedc9fdbb9ca87529d4a62d4f6c5"}
Jul 07 15:45:25.000810 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.000748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:25.018083 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.018024    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp" podStartSLOduration=2.018001766 podStartE2EDuration="2.018001766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:25.017215979 +0000 UTC m=+2682.282960972" watchObservedRunningTime="2026-07-07 15:45:25.018001766 +0000 UTC m=+2682.283746744"
Jul 07 15:45:25.569413 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.569382    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mgddn_dd0a9694-7f69-467c-aeda-a4eef34a5fb5/dns/0.log"
Jul 07 15:45:25.588740 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.588704    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mgddn_dd0a9694-7f69-467c-aeda-a4eef34a5fb5/kube-rbac-proxy/0.log"
Jul 07 15:45:25.610989 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:25.610953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pmgg_574deda0-e040-43d4-a738-a367b326c1eb/dns-node-resolver/0.log"
Jul 07 15:45:26.198817 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:26.198786    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2twf9_87bbadc7-56f2-46f9-907e-5af352736689/node-ca/0.log"
Jul 07 15:45:27.385910 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:27.385877    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-f9nml_8e0e6e00-68ab-4279-b0a5-852c46cb351f/kube-auth-proxy/0.log"
Jul 07 15:45:28.313474 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:28.313438    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvnf6_18ea881c-9d0a-46a8-baa1-ad30858314d9/serve-healthcheck-canary/0.log"
Jul 07 15:45:28.965706 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:28.965671    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkpwg_ac12beb0-8932-4ea9-b0e8-243a71893956/kube-rbac-proxy/0.log"
Jul 07 15:45:28.984022 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:28.983992    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkpwg_ac12beb0-8932-4ea9-b0e8-243a71893956/exporter/0.log"
Jul 07 15:45:29.006896 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:29.006848    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tkpwg_ac12beb0-8932-4ea9-b0e8-243a71893956/extractor/0.log"
Jul 07 15:45:31.019479 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:31.019451    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-qzhtp"
Jul 07 15:45:31.568861 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:31.568832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-78lrl_d335a360-aad1-41f2-918e-aa1b4c52ac96/manager/0.log"
Jul 07 15:45:31.589622 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:31.589594    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-78lrl_d335a360-aad1-41f2-918e-aa1b4c52ac96/copy-manifests/0.log"
Jul 07 15:45:33.146458 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:33.146421    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55947775b5-v8wvs_1dd09e42-ee5d-42f7-a7a2-f36456fec396/manager/0.log"
Jul 07 15:45:33.171562 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:33.171501    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7ngmg_d9ffde52-4550-4089-8a2c-a11122f4ce8c/openshift-lws-operator/0.log"
Jul 07 15:45:34.281971 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:34.281942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-f9nml_8e0e6e00-68ab-4279-b0a5-852c46cb351f/kube-auth-proxy/0.log"
Jul 07 15:45:35.970518 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:35.970478    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-f9nml_8e0e6e00-68ab-4279-b0a5-852c46cb351f/kube-auth-proxy/0.log"
Jul 07 15:45:38.452178 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:38.452148    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-m582f_76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615/migrator/0.log"
Jul 07 15:45:38.500757 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:38.500730    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-m582f_76a6c4b8-c1b9-428c-a8e6-ac07e7ba5615/graceful-termination/0.log"
Jul 07 15:45:39.916920 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:39.916887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/kube-multus-additional-cni-plugins/0.log"
Jul 07 15:45:39.937177 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:39.937148    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/egress-router-binary-copy/0.log"
Jul 07 15:45:39.958521 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:39.958491    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/cni-plugins/0.log"
Jul 07 15:45:39.978709 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:39.978675    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/bond-cni-plugin/0.log"
Jul 07 15:45:39.996530 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:39.996495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/routeoverride-cni/0.log"
Jul 07 15:45:40.015669 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:40.015637    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/whereabouts-cni-bincopy/0.log"
Jul 07 15:45:40.036135 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:40.036099    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n9cq_d7a16cba-ac3d-47f8-a96f-e1e8b535fc98/whereabouts-cni/0.log"
Jul 07 15:45:40.371685 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:40.371649    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tbqkn_5482255c-1d65-49de-bc8b-743774bb6e76/kube-multus/0.log"
Jul 07 15:45:40.462146 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:40.462110    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9v6gc_19582102-62e4-4d46-821e-d05b20aede59/network-metrics-daemon/0.log"
Jul 07 15:45:40.480320 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:40.480292    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9v6gc_19582102-62e4-4d46-821e-d05b20aede59/kube-rbac-proxy/0.log"
Jul 07 15:45:41.343185 ip-10-0-131-27 kubenswrapper[2583]: I0707 15:45:41.343141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qm5p6_b41caeac-251a-42e9-856a-8656f00edfc8/konnectivity-agent/0.log" limit=1024