Jul 14 15:46:34.130913 ip-10-0-129-145 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 15:46:34.532851 ip-10-0-129-145 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 15:46:34.532851 ip-10-0-129-145 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 15:46:34.532851 ip-10-0-129-145 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 15:46:34.532851 ip-10-0-129-145 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 15:46:34.532851 ip-10-0-129-145 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 15:46:34.533416 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.532859    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 15:46:34.537164 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537148    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.537164 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537162    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537173    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537179    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537184    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537188    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537192    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537195    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537200    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537204    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537208    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537215    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537220    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537224    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537228    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537232    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537236    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537240    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537243    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537247    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.537310 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537251    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537255    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537259    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537263    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537269    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537274    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537279    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537284    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537290    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537296    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537303    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537307    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537311    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537316    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537320    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537325    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537329    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537334    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537338    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.538160 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537342    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537346    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537351    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537355    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537359    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537365    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537369    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537373    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537377    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537381    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537385    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537390    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537394    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537398    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537402    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537408    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537412    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537417    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537421    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537426    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.538866 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537430    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537434    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537438    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537442    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537446    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537451    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537456    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537460    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537464    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537469    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537473    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537478    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537482    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537486    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537490    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537494    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537498    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537502    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537506    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537510    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.539625 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537514    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537519    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537523    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537528    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537532    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537538    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537542    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537547    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537551    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537555    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537560    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537564    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537568    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537572    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537576    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537581    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537585    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537609    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537614    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.540094 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.537618    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540555    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540568    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540572    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540575    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540579    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540583    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540587    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540602    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.540603 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540606    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540609    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540613    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540615    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540618    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540621    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540624    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540627    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540630    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540633    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540635    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540638    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540643    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540646    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540649    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540652    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540654    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540657    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540659    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540662    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.540826 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540664    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540672    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540675    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540677    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540680    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540682    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540685    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540687    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540690    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540693    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540695    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540697    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540700    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540703    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540706    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540710    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540712    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540715    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540717    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.541342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540720    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540722    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540725    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540729    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540732    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540734    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540737    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540739    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540742    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540744    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540747    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540749    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540752    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540754    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540757    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540759    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540762    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540764    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540767    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540771    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.541819 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540775    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540778    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540781    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540784    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540787    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540790    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540794    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540797    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540800    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540803    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540805    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540808    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540810    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540813    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540816    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540818    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540821    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540824    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540826    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540829    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.542305 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540832    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540835    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540837    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540840    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540842    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540845    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540847    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540850    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540852    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540855    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540858    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.540861    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541224    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541229    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541232    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541236    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541240    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541243    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541246    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541249    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.542791 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541252    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541254    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541257    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541259    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541261    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541264    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541267    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541271    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541275    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541278    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541281    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541283    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541285    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541288    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541290    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541293    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541295    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541298    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541300    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541303    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.543272 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541305    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541308    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541311    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541314    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541316    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541319    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541321    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541324    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541326    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541329    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541331    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541334    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541336    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541339    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541342    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541346    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541349    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541351    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541355    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.543774 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541357    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541360    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541363    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541365    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541368    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541370    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541373    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541375    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541377    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541380    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541382    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541385    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541387    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541389    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541392    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541395    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541397    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541400    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541402    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541405    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.544237 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541407    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541410    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541412    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541414    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541417    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541420    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541423    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541425    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541428    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541430    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541434    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541436    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541439    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541441    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541443    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541446    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541449    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541451    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541453    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.544733 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541455    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541458    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541461    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541463    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541465    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541468    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541470    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541473    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541475    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541478    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541480    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541483    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.541485    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541545    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541551    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541563    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541575    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541578    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541581    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541585    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541608    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 15:46:34.545186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541613    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541617    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541621    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541624    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541627    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541630    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541633    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541635    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541639    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541642    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541646    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541648    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541651    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541654    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541657    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541665    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541668    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541674    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541677    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541680    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541683    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541686    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541689    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541692    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 15:46:34.545717 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541699    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541701    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541704    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541707    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541710    2564 flags.go:64] FLAG: --enable-server="true"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541713    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541717    2564 flags.go:64] FLAG: --event-burst="100"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541720    2564 flags.go:64] FLAG: --event-qps="50"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541723    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541726    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541729    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541733    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541735    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541738    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541741    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541744    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541746    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541750    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541752    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541755    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541758    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541761    2564 flags.go:64] FLAG: --feature-gates=""
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541764    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541767    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541770    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 15:46:34.546339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541774    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541777    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541780    2564 flags.go:64] FLAG: --help="false"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541784    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541787    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541790    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541793    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541796    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541799    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541802    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541805    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541808    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541810    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541813    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541816    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541819    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541822    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541825    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541828    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541831    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541833    2564 flags.go:64] FLAG: --lock-file=""
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541836    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541839    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541842    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 15:46:34.546975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541847    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541850    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541853    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541856    2564 flags.go:64] FLAG: --logging-format="text"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541859    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541862    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541864    2564 flags.go:64] FLAG: --manifest-url=""
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541873    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541881    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541884    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541888    2564 flags.go:64] FLAG: --max-pods="110"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541892    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541895    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541898    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541901    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541904    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541906    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541909    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541916    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541919    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541922    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541925    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541927    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 15:46:34.547530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541933    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541935    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541938    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541941    2564 flags.go:64] FLAG: --port="10250"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541944    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541947    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a0972fff0e523e97"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541950    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541953    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541955    2564 flags.go:64] FLAG: --register-node="true"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541958    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541961    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541965    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541968    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541971    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541975    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541978    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541980    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541983    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541987    2564 flags.go:64] FLAG: --runonce="false"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541990    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541994    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.541997    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542000    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542003    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542006    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542008    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 15:46:34.548124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542011    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542014    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542017    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542020    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542022    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542025    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542028    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542031    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542036    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542039    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542041    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542045    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542047    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542050    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542053    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542055    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542058    2564 flags.go:64] FLAG: --v="2"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542062    2564 flags.go:64] FLAG: --version="false"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542066    2564 flags.go:64] FLAG: --vmodule=""
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542069    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.542072    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542177    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542181    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542184    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.548759 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542188    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542190    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542195    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542197    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542200    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542203    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542205    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542208    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542211    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542213    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542216    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542218    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542221    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542223    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542226    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542229    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542231    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542234    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542236    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.549328 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542241    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542244    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542247    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542250    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542253    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542256    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542258    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542261    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542264    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542267    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542269    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542272    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542274    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542278    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542281    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542285    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542289    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542292    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542294    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542297    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.549843 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542300    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542302    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542305    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542307    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542310    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542312    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542315    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542318    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542320    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542323    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542326    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542329    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542331    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542334    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542336    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542339    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542342    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542344    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542346    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542349    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.550342 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542352    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542354    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542357    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542360    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542362    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542366    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542369    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542373    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542375    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542378    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542380    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542383    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542385    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542388    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542390    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542393    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542396    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542398    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542401    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542404    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.550841 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542406    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542409    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542411    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542414    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542416    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542419    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542421    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542424    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542426    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542430    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542433    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542436    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542439    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542442    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542445    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542448    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.551318 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.542451    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.543128    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.549228    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.549243    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.549258    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.549264    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549317    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549321    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549325    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549328    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549334    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549337    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549340    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549343    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.551719 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549345    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549348    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549350    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549353    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549356    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549359    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549362    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549365    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549368    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549370    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549373    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549376    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549379    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549381    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549383    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549386    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549388    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549391    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549394    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549397    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.552080 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549400    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549403    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549406    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549408    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549411    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549413    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549415    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549418    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549420    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549423    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549425    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549428    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549430    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549433    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549435    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549438    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549442    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549445    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549448    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.552549 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549451    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549453    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549456    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549459    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549461    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549464    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549466    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549469    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549471    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549473    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549476    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549480    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549482    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549485    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549489    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549493    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549497    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549499    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549503    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549507    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.553057 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549509    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549512    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549515    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549517    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549519    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549522    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549524    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549527    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549529    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549532    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549534    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549537    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549539    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549541    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549544    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549546    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549549    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549552    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549554    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549556    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.553534 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549559    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549561    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549564    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549567    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549569    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549572    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549574    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549577    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549580    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549583    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549585    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.549609    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549729    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549734    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549737    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 15:46:34.554035 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549740    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549743    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549746    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549748    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549751    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549754    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549756    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549759    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549761    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549765    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549768    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549771    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549774    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549777    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549780    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549783    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549786    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549788    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549791    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 15:46:34.554427 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549793    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549796    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549798    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549801    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549803    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549806    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549809    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549812    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549815    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549819    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549821    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549824    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549827    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549829    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549832    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549834    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549836    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549839    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549841    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 15:46:34.555004 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549844    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549846    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549849    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549851    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549854    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549857    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549859    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549862    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549864    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549875    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549878    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549880    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549883    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549885    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549888    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549890    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549893    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549895    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549898    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549900    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 15:46:34.555451 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549903    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549906    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549908    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549911    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549913    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549915    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549918    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549920    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549923    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549925    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549927    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549930    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549932    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549934    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549937    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549939    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549942    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549944    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549946    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549949    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 15:46:34.555938 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549952    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549954    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549956    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549959    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549961    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549963    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549966    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549969    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549971    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549975    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549978    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549981    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549984    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549987    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549990    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549992    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549995    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 15:46:34.556395 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:34.549997    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.550002    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.550091    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.552701    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.554235    2564 server.go:1019] "Starting client certificate rotation"
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.554337    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.554385    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 15:46:34.556871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.556574    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 15:46:34.561149 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.561135    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 15:46:34.569770 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.569755    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 14 15:46:34.572527 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.572510    2564 log.go:25] "Validated CRI v1 image API"
Jul 14 15:46:34.573240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.573226    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 15:46:34.575623 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.575586    2564 fs.go:135] Filesystem UUIDs: map[133feeef-1178-4490-a849-7de6e12e7ccc:/dev/nvme0n1p3 3b124242-70df-477c-b626-d0fcefc01473:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 14 15:46:34.575679 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.575624    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 15:46:34.581586 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.581480    2564 manager.go:216] Machine: {Timestamp:2026-07-14 15:46:34.580265696 +0000 UTC m=+0.325662215 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3051766 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec209df54f5c02c6718ecb03110e01fb SystemUUID:ec209df5-4f5c-02c6-718e-cb03110e01fb BootID:cddcc447-2a76-4a42-8bcf-be99b82a3fea Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:76:2f:de:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:76:2f:de:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:c9:35:00:b3:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 15:46:34.581586 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.581578    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 15:46:34.581715 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.581659    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 15:46:34.584651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.584632    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 15:46:34.584775 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.584653    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 15:46:34.585570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.585561    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 15:46:34.585645 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.585572    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 15:46:34.585645 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.585579    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 15:46:34.586258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.586246    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 15:46:34.588160 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.588149    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 15:46:34.588827 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.588810    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 15:46:34.591700 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591688    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 15:46:34.591807 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591797    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 15:46:34.591838 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591827    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 15:46:34.591838 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591836    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 15:46:34.591888 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591848    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 15:46:34.591888 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591857    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 14 15:46:34.591888 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.591866    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 15:46:34.592221 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.592200    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 15:46:34.592221 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.592225    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 15:46:34.594119 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.594097    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 15:46:34.595967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.595954    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 15:46:34.596003 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.595987    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 15:46:34.596147 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596138    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 15:46:34.596177 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596153    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 15:46:34.596177 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596159    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 15:46:34.596177 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596164    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 15:46:34.596177 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596174    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 15:46:34.596278 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596183    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 15:46:34.596618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596609    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 15:46:34.596648 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596618    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 15:46:34.596648 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596624    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 15:46:34.596648 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596630    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 15:46:34.596648 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596643    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 15:46:34.596750 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.596651    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 15:46:34.597434 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.597425    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 15:46:34.597465 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.597436    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 15:46:34.600443 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.600428    2564 server.go:1268] "Started kubelet"
Jul 14 15:46:34.600534 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.600509    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 15:46:34.600611 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.600503    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 15:46:34.600611 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.600581    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 15:46:34.601050 ip-10-0-129-145 systemd[1]: Started Kubernetes Kubelet.
Jul 14 15:46:34.601988 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.601885    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 15:46:34.606185 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.606152    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 15:46:34.607383 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.607366    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 15:46:34.607494 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.607435    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 15:46:34.607534 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.607489    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 15:46:34.608755 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.606822    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f91d361f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.600399349 +0000 UTC m=+0.345795867,LastTimestamp:2026-07-14 15:46:34.600399349 +0000 UTC m=+0.345795867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.609411 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.609388    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 15:46:34.610565 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.610547    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 15:46:34.610565 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.610558    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 15:46:34.610727 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.610661    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:34.611266 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611222    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 15:46:34.611755 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611736    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 15:46:34.611755 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611758    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 15:46:34.611886 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611852    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 15:46:34.611886 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611862    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 15:46:34.612093 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.611994    2564 factory.go:55] Registering systemd factory
Jul 14 15:46:34.612161 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612122    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 14 15:46:34.612367 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612354    2564 factory.go:153] Registering CRI-O factory
Jul 14 15:46:34.612415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612371    2564 factory.go:223] Registration of the crio container factory successfully
Jul 14 15:46:34.612449 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612420    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 15:46:34.612449 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612445    2564 factory.go:103] Registering Raw factory
Jul 14 15:46:34.612508 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.612461    2564 manager.go:1196] Started watching for new ooms in manager
Jul 14 15:46:34.613106 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.613090    2564 manager.go:349] Starting recovery of all containers
Jul 14 15:46:34.622848 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.622820    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 15:46:34.622964 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.622940    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 15:46:34.624784 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.624769    2564 manager.go:354] Recovery completed
Jul 14 15:46:34.637628 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.637513    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.639554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.639539    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.639657 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.639569    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.639657 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.639581    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.640089 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640070    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 15:46:34.640089 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640089    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 15:46:34.640226 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640107    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 15:46:34.640226 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640092    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.640742 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640723    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.640835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640751    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.640835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.640762    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.641714 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.641699    2564 policy_none.go:49] "None policy: Start"
Jul 14 15:46:34.641714 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.641717    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 15:46:34.641814 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.641727    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 15:46:34.642736 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.642725    2564 policy_none.go:47] "Start"
Jul 14 15:46:34.649487 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.649428    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f9428dad8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639555288 +0000 UTC m=+0.384951809,LastTimestamp:2026-07-14 15:46:34.639555288 +0000 UTC m=+0.384951809,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.652884 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.652826    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f94292a02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639575554 +0000 UTC m=+0.384972075,LastTimestamp:2026-07-14 15:46:34.639575554 +0000 UTC m=+0.384972075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.658863 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.658481    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f9429504d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639585357 +0000 UTC m=+0.384981875,LastTimestamp:2026-07-14 15:46:34.639585357 +0000 UTC m=+0.384981875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.662443 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.662358    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-145.ec2.internal.18c2328f9428dad8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f9428dad8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639555288 +0000 UTC m=+0.384951809,LastTimestamp:2026-07-14 15:46:34.640737649 +0000 UTC m=+0.386134168,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.662540 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.662469    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wkrwv"
Jul 14 15:46:34.668048 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.667987    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-145.ec2.internal.18c2328f94292a02\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f94292a02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639575554 +0000 UTC m=+0.384972075,LastTimestamp:2026-07-14 15:46:34.640756676 +0000 UTC m=+0.386153194,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.670804 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.670788    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wkrwv"
Jul 14 15:46:34.675845 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.675758    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-145.ec2.internal.18c2328f9429504d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18c2328f9429504d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-145.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-07-14 15:46:34.639585357 +0000 UTC m=+0.384981875,LastTimestamp:2026-07-14 15:46:34.640765392 +0000 UTC m=+0.386161910,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678542    2564 manager.go:337] "Starting Device Plugin manager"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.678565    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678573    2564 server.go:87] "Starting device plugin registration server"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678773    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678784    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678855    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678930    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.678938    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.679407    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 15:46:34.696464 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.679445    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:34.761441 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.761420    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 15:46:34.762679 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.762661    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 15:46:34.762769 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.762704    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 15:46:34.762769 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.762726    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 15:46:34.762769 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.762765    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 15:46:34.765524 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.765503    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:34.779694 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.779679    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.780397 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.780374    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.780490 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.780407    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.780490 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.780421    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.780490 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.780448    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.790221 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.790184    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.790221 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.790202    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-145.ec2.internal\": node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:34.822146 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.822120    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:34.862987 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.862965    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"]
Jul 14 15:46:34.863045 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.863034    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.864730 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.864714    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.864781 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.864743    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.864781 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.864753    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.865971 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.865958    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.866133 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866120    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.866194 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866147    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.866635 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866616    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.866635 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866628    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.866724 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866646    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.866724 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866656    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.866724 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866646    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.866810 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.866726    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.867914 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.867896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.868002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.867926    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:34.868582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.868566    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:34.868699 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.868617    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:34.868699 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.868629    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:34.901087 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.901063    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-145.ec2.internal\" not found" node="ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.905236 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.905216    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-145.ec2.internal\" not found" node="ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.912774 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.912756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.912850 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.912781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.912850 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:34.912797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec04f0b7858ab684c71a8a77a26f2b63-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"ec04f0b7858ab684c71a8a77a26f2b63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:34.922518 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:34.922504    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.013496 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.013620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.013620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec04f0b7858ab684c71a8a77a26f2b63-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"ec04f0b7858ab684c71a8a77a26f2b63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.013620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.013620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec04f0b7858ab684c71a8a77a26f2b63-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"ec04f0b7858ab684c71a8a77a26f2b63\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.013620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.013570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f142b672a83761a7d0130506f4b7a25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"f142b672a83761a7d0130506f4b7a25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.023598 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.023577    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.124433 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.124387    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.203624 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.203602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.209193 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.209175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:35.224979 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.224959    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.325540 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.325507    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.426009 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.425953    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.526533 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.526502    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.545962 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.545940    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:35.553146 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.553123    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 15:46:35.553256 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.553237    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 15:46:35.553324 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.553288    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 15:46:35.626988 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.626965    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.676984 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.676931    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 15:41:34 +0000 UTC" deadline="2028-02-06 23:01:59.573020574 +0000 UTC"
Jul 14 15:46:35.676984 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.676960    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13735h15m23.896063536s"
Jul 14 15:46:35.727535 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.727513    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.824044 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.824017    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 15:46:35.824930 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.824915    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 15:46:35.825004 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.824946    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 15:46:35.825004 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:35.824957    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID"
Jul 14 15:46:35.828069 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.828051    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:35.928663 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:35.928616    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:36.007194 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.007172    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:36.029507 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.029480    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:36.130266 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.130240    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found"
Jul 14 15:46:36.199839 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.199819    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:36.210722 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.210701    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:36.221248 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.221231    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 15:46:36.222171 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.222158    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"
Jul 14 15:46:36.234563 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.234548    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 15:46:36.318984 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.318956    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec04f0b7858ab684c71a8a77a26f2b63.slice/crio-8ebe02eac450306ed396ee9fe9fb5fd319ea77c47590166041586a4789ca89a1 WatchSource:0}: Error finding container 8ebe02eac450306ed396ee9fe9fb5fd319ea77c47590166041586a4789ca89a1: Status 404 returned error can't find the container with id 8ebe02eac450306ed396ee9fe9fb5fd319ea77c47590166041586a4789ca89a1
Jul 14 15:46:36.319368 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.319347    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf142b672a83761a7d0130506f4b7a25f.slice/crio-ebd88342821d46012ffacc23fa0352e5bf835c382b65fc4595df7bb4d7efbed5 WatchSource:0}: Error finding container ebd88342821d46012ffacc23fa0352e5bf835c382b65fc4595df7bb4d7efbed5: Status 404 returned error can't find the container with id ebd88342821d46012ffacc23fa0352e5bf835c382b65fc4595df7bb4d7efbed5
Jul 14 15:46:36.325068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.325049    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 15:46:36.593020 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.592963    2564 apiserver.go:52] "Watching apiserver"
Jul 14 15:46:36.601030 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.601008    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 15:46:36.601433 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.601409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx","openshift-cluster-node-tuning-operator/tuned-qqgj2","openshift-image-registry/node-ca-vbbd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal","openshift-network-operator/iptables-alerter-4qzgh","openshift-dns/node-resolver-gbxkv","openshift-multus/multus-additional-cni-plugins-w9q8v","openshift-multus/multus-h29dq","openshift-multus/network-metrics-daemon-5gm7n","openshift-network-diagnostics/network-check-target-cjt5m","openshift-ovn-kubernetes/ovnkube-node-zfsmd","kube-system/global-pull-secret-syncer-zcj7p","kube-system/konnectivity-agent-844v5"]
Jul 14 15:46:36.603819 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.603799    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.605510 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.605479    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.606730 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.606678    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.606963 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.606948    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.607097 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.607075    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.607908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.607883    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 15:46:36.607908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.607898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9sd4n\""
Jul 14 15:46:36.608074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.607896    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.608074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.607982    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 15:46:36.608682 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.608659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:36.608818 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.608693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwqcx\""
Jul 14 15:46:36.608818 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.608751    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:36.608967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.608663    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 15:46:36.608967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.608862    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.609224 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.609205    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 15:46:36.609224 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.609216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.609341 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.609293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jlpxs\""
Jul 14 15:46:36.609585 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.609570    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.610216 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.610184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.610793 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.610773    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 15:46:36.611651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.611609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.613025 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.613006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.613181 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.613146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.613278 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.613249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 15:46:36.614580 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.614419    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r6fxk\""
Jul 14 15:46:36.614580 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.614476    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.615389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.615133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-btfwv\""
Jul 14 15:46:36.615737 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.615715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.616384 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.616356    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.616807 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.616772    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 15:46:36.616967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.616949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.618470 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.618448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 15:46:36.618586 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.618540    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.618725 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.618710    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 15:46:36.618959 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.618937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.619065 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.619004    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:36.619868 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.619850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 15:46:36.620050 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.620026    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.620279 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.620263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s8qgb\""
Jul 14 15:46:36.620329 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.620300    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 15:46:36.620587 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.620566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.621586 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.621566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5dl98\""
Jul 14 15:46:36.622266 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-systemd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622373 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-etc-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622373 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.622373 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-ovn\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622373 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.622348    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:36.622373 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovn-node-metrics-cert\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-script-lib\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-lib-modules\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-bin\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysconfig\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-conf\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:36.622570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40d4eb53-5894-4a30-8fd1-709ffc21af97-serviceca\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50ae58fb-539d-42b7-b173-4712ec46f049-iptables-alerter-script\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cbdc016-105a-4500-9c29-c0b6786fff34-hosts-file\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6rt\" (UniqueName: \"kubernetes.io/projected/6cbdc016-105a-4500-9c29-c0b6786fff34-kube-api-access-ht6rt\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-systemd-units\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-node-log\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-kubernetes\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-run\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-host\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50ae58fb-539d-42b7-b173-4712ec46f049-host-slash\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-var-lib-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-config\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbsfx\" (UniqueName: \"kubernetes.io/projected/dd127c69-fb56-44f4-b03c-7fa56b6dca05-kube-api-access-kbsfx\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-systemd\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-tuned\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-tmp\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.622940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d4eb53-5894-4a30-8fd1-709ffc21af97-host\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.622971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-netd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-env-overrides\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgn57\" (UniqueName: \"kubernetes.io/projected/40d4eb53-5894-4a30-8fd1-709ffc21af97-kube-api-access-xgn57\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cbdc016-105a-4500-9c29-c0b6786fff34-tmp-dir\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-kubelet\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-netns\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsk8\" (UniqueName: \"kubernetes.io/projected/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-kube-api-access-tgsk8\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5gl\" (UniqueName: \"kubernetes.io/projected/50ae58fb-539d-42b7-b173-4712ec46f049-kube-api-access-9r5gl\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-slash\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-log-socket\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-modprobe-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-var-lib-kubelet\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.623595 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-sys\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.624247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623633    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 15:46:36.624247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 15:46:36.624247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.624247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.623871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ddl8k\""
Jul 14 15:46:36.624247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.624011    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 15:46:36.626820 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.626803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rnnwp\""
Jul 14 15:46:36.626998 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.626981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 15:46:36.627083 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.627038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 15:46:36.629989 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.629970    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 15:46:36.664524 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.664508    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x547m"
Jul 14 15:46:36.673374 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.673361    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x547m"
Jul 14 15:46:36.712667 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.712648    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 15:46:36.721621 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.721585    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:36.723940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.723430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-conf-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.724029 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.723952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovn-node-metrics-cert\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724029 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.723968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-script-lib\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724029 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.723985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-socket-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.724029 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50ae58fb-539d-42b7-b173-4712ec46f049-host-slash\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-k8s-cni-cncf-io\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50ae58fb-539d-42b7-b173-4712ec46f049-host-slash\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-os-release\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-node-log\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-kubernetes\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-host\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-node-log\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-socket-dir-parent\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-kubernetes\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-host\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rg2\" (UniqueName: \"kubernetes.io/projected/ed442b70-a240-407b-acf9-d6e76604fa93-kube-api-access-c9rg2\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724506    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-config\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsfx\" (UniqueName: \"kubernetes.io/projected/dd127c69-fb56-44f4-b03c-7fa56b6dca05-kube-api-access-kbsfx\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-device-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-netd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgn57\" (UniqueName: \"kubernetes.io/projected/40d4eb53-5894-4a30-8fd1-709ffc21af97-kube-api-access-xgn57\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cnibin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-os-release\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-dbus\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cbdc016-105a-4500-9c29-c0b6786fff34-tmp-dir\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-kubelet\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.724853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsk8\" (UniqueName: \"kubernetes.io/projected/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-kube-api-access-tgsk8\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5gl\" (UniqueName: \"kubernetes.io/projected/50ae58fb-539d-42b7-b173-4712ec46f049-kube-api-access-9r5gl\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cnibin\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-netd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-slash\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-log-socket\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-konnectivity-ca\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-sys\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.724988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-multus-certs\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-systemd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-etc-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-slash\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-ovn\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-lib-modules\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-log-socket\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.725538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7gmg\" (UniqueName: \"kubernetes.io/projected/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-kube-api-access-d7gmg\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-bin\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysconfig\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-lib-modules\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-conf\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40d4eb53-5894-4a30-8fd1-709ffc21af97-serviceca\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50ae58fb-539d-42b7-b173-4712ec46f049-iptables-alerter-script\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cbdc016-105a-4500-9c29-c0b6786fff34-hosts-file\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6rt\" (UniqueName: \"kubernetes.io/projected/6cbdc016-105a-4500-9c29-c0b6786fff34-kube-api-access-ht6rt\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-systemd-units\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-run\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-system-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-multus\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cbdc016-105a-4500-9c29-c0b6786fff34-tmp-dir\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.726189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t25sz\" (UniqueName: \"kubernetes.io/projected/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-kube-api-access-t25sz\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-var-lib-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-systemd\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-kubelet\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-tuned\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-tmp\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.725695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d4eb53-5894-4a30-8fd1-709ffc21af97-host\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-config\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-agent-certs\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovnkube-script-lib\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-env-overrides\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-kubelet\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-daemon-config\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.726844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-etc-kubernetes\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-registration-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-netns\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.726995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cni-binary-copy\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-netns\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zhc\" (UniqueName: \"kubernetes.io/projected/fb8bff05-2cf4-4158-890a-0e6f36d87559-kube-api-access-24zhc\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727217    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-netns\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-modprobe-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-var-lib-kubelet\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.727582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-sys\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-ovn\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-cni-bin\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-etc-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysconfig\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-sysctl-conf\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.727997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.727991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-var-lib-openvswitch\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.728204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-systemd-units\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.728204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-run\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.728204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40d4eb53-5894-4a30-8fd1-709ffc21af97-serviceca\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.728558 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50ae58fb-539d-42b7-b173-4712ec46f049-iptables-alerter-script\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.728638 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cbdc016-105a-4500-9c29-c0b6786fff34-hosts-file\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.728685 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-bin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.728721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-sys-fs\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.728721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-kubelet-config\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.728803 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.728803 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-hostroot\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.728912 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-var-lib-kubelet\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.729028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.728990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-modprobe-d\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.729085 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.729039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd127c69-fb56-44f4-b03c-7fa56b6dca05-run-systemd\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.730483 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.730456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d4eb53-5894-4a30-8fd1-709ffc21af97-host\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.730588 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.730561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-systemd\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.730770 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.730748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd127c69-fb56-44f4-b03c-7fa56b6dca05-env-overrides\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.731219 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.731187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-tmp\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.731309 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.731222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd127c69-fb56-44f4-b03c-7fa56b6dca05-ovn-node-metrics-cert\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.732667 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.732645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-etc-tuned\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.737828 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.737806    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:36.737933 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.737835    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:36.737933 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.737858    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:36.737933 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.737930    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:46:37.237910551 +0000 UTC m=+2.983307059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:36.741956 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.741930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbsfx\" (UniqueName: \"kubernetes.io/projected/dd127c69-fb56-44f4-b03c-7fa56b6dca05-kube-api-access-kbsfx\") pod \"ovnkube-node-zfsmd\" (UID: \"dd127c69-fb56-44f4-b03c-7fa56b6dca05\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.742059 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.741936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsk8\" (UniqueName: \"kubernetes.io/projected/bf5c31fc-07fc-494a-9f70-e3953cbbfb40-kube-api-access-tgsk8\") pod \"tuned-qqgj2\" (UID: \"bf5c31fc-07fc-494a-9f70-e3953cbbfb40\") " pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.742504 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.742197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6rt\" (UniqueName: \"kubernetes.io/projected/6cbdc016-105a-4500-9c29-c0b6786fff34-kube-api-access-ht6rt\") pod \"node-resolver-gbxkv\" (UID: \"6cbdc016-105a-4500-9c29-c0b6786fff34\") " pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.743220 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.743202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5gl\" (UniqueName: \"kubernetes.io/projected/50ae58fb-539d-42b7-b173-4712ec46f049-kube-api-access-9r5gl\") pod \"iptables-alerter-4qzgh\" (UID: \"50ae58fb-539d-42b7-b173-4712ec46f049\") " pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.743609 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.743573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgn57\" (UniqueName: \"kubernetes.io/projected/40d4eb53-5894-4a30-8fd1-709ffc21af97-kube-api-access-xgn57\") pod \"node-ca-vbbd6\" (UID: \"40d4eb53-5894-4a30-8fd1-709ffc21af97\") " pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.767135 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.767097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" event={"ID":"ec04f0b7858ab684c71a8a77a26f2b63","Type":"ContainerStarted","Data":"8ebe02eac450306ed396ee9fe9fb5fd319ea77c47590166041586a4789ca89a1"}
Jul 14 15:46:36.768285 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.768256    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"f142b672a83761a7d0130506f4b7a25f","Type":"ContainerStarted","Data":"ebd88342821d46012ffacc23fa0352e5bf835c382b65fc4595df7bb4d7efbed5"}
Jul 14 15:46:36.829014 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.828989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-k8s-cni-cncf-io\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.829102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-os-release\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.829102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.829102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-socket-dir-parent\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rg2\" (UniqueName: \"kubernetes.io/projected/ed442b70-a240-407b-acf9-d6e76604fa93-kube-api-access-c9rg2\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-k8s-cni-cncf-io\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-device-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.829131    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-os-release\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-device-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cnibin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.829200    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:46:37.329183631 +0000 UTC m=+3.074580153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-socket-dir-parent\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-os-release\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-dbus\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cnibin\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.829312 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-konnectivity-ca\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-os-release\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-multus-certs\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7gmg\" (UniqueName: \"kubernetes.io/projected/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-kube-api-access-d7gmg\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-etc-selinux\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cnibin\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-system-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-dbus\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-multus\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-multus-certs\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cnibin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t25sz\" (UniqueName: \"kubernetes.io/projected/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-kube-api-access-t25sz\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.830785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-agent-certs\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-system-cni-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-kubelet\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-daemon-config\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-etc-kubernetes\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.829805    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:36.829842    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:46:37.329830861 +0000 UTC m=+3.075227366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-registration-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cni-binary-copy\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-multus\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-netns\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zhc\" (UniqueName: \"kubernetes.io/projected/fb8bff05-2cf4-4158-890a-0e6f36d87559-kube-api-access-24zhc\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-bin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-sys-fs\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-kubelet-config\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.829998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-hostroot\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-conf-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-run-netns\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-registration-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-konnectivity-ca\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-socket-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-socket-dir\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/acc19301-6af9-4e33-8ec0-44065de95e6c-kubelet-config\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-hostroot\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-cni-bin\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-conf-dir\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.831966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb8bff05-2cf4-4158-890a-0e6f36d87559-sys-fs\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-etc-kubernetes\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-host-var-lib-kubelet\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-multus-daemon-config\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-cni-binary-copy\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.830882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.832632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.832307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c-agent-certs\") pod \"konnectivity-agent-844v5\" (UID: \"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c\") " pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.851384 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.851337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zhc\" (UniqueName: \"kubernetes.io/projected/fb8bff05-2cf4-4158-890a-0e6f36d87559-kube-api-access-24zhc\") pod \"aws-ebs-csi-driver-node-p9cmx\" (UID: \"fb8bff05-2cf4-4158-890a-0e6f36d87559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.857390 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.857357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7gmg\" (UniqueName: \"kubernetes.io/projected/970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc-kube-api-access-d7gmg\") pod \"multus-additional-cni-plugins-w9q8v\" (UID: \"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc\") " pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.858198 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.858179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rg2\" (UniqueName: \"kubernetes.io/projected/ed442b70-a240-407b-acf9-d6e76604fa93-kube-api-access-c9rg2\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:36.858291 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.858230    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t25sz\" (UniqueName: \"kubernetes.io/projected/fdf64f5f-e738-49fd-8518-0974f2dc9dbb-kube-api-access-t25sz\") pod \"multus-h29dq\" (UID: \"fdf64f5f-e738-49fd-8518-0974f2dc9dbb\") " pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.916625 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.916604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbxkv"
Jul 14 15:46:36.925784 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.925762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:46:36.927206 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.927187    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbdc016_105a_4500_9c29_c0b6786fff34.slice/crio-a88b905a47821dbf172bccf750ee8926e663f377c819e089b79071b3c163f9cd WatchSource:0}: Error finding container a88b905a47821dbf172bccf750ee8926e663f377c819e089b79071b3c163f9cd: Status 404 returned error can't find the container with id a88b905a47821dbf172bccf750ee8926e663f377c819e089b79071b3c163f9cd
Jul 14 15:46:36.932240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.932217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqgj2"
Jul 14 15:46:36.936291 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.935881    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd127c69_fb56_44f4_b03c_7fa56b6dca05.slice/crio-7b73634605bbf208021c18e056c30880d2bf19fda23fba07b0e63b4b0566fe16 WatchSource:0}: Error finding container 7b73634605bbf208021c18e056c30880d2bf19fda23fba07b0e63b4b0566fe16: Status 404 returned error can't find the container with id 7b73634605bbf208021c18e056c30880d2bf19fda23fba07b0e63b4b0566fe16
Jul 14 15:46:36.936965 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.936944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbbd6"
Jul 14 15:46:36.942653 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.942633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qzgh"
Jul 14 15:46:36.943367 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.943346    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5c31fc_07fc_494a_9f70_e3953cbbfb40.slice/crio-e817ab8f9291e35b07012015b2c17eea728cc54edbc0853415d998eb9fe362e1 WatchSource:0}: Error finding container e817ab8f9291e35b07012015b2c17eea728cc54edbc0853415d998eb9fe362e1: Status 404 returned error can't find the container with id e817ab8f9291e35b07012015b2c17eea728cc54edbc0853415d998eb9fe362e1
Jul 14 15:46:36.949072 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.949050    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d4eb53_5894_4a30_8fd1_709ffc21af97.slice/crio-ea6bc15c7c14a03a7c4abd4c7bb09f7c4da93bcfa0b0cfb9ce578584da867531 WatchSource:0}: Error finding container ea6bc15c7c14a03a7c4abd4c7bb09f7c4da93bcfa0b0cfb9ce578584da867531: Status 404 returned error can't find the container with id ea6bc15c7c14a03a7c4abd4c7bb09f7c4da93bcfa0b0cfb9ce578584da867531
Jul 14 15:46:36.949887 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.949841    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9q8v"
Jul 14 15:46:36.952261 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.952228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ae58fb_539d_42b7_b173_4712ec46f049.slice/crio-ae44f83daf4a663c7fcae6107c5c7e2fd7a4fb89146df18789927a2c5c4a3795 WatchSource:0}: Error finding container ae44f83daf4a663c7fcae6107c5c7e2fd7a4fb89146df18789927a2c5c4a3795: Status 404 returned error can't find the container with id ae44f83daf4a663c7fcae6107c5c7e2fd7a4fb89146df18789927a2c5c4a3795
Jul 14 15:46:36.955417 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.955399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h29dq"
Jul 14 15:46:36.959558 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.959533    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970aa2d0_5821_486f_b9a2_ca2b1b9ef8cc.slice/crio-7cbf0386abea5fc3f9a3cc38f2b7bd282232f8cb66c3106e4958f90688244c44 WatchSource:0}: Error finding container 7cbf0386abea5fc3f9a3cc38f2b7bd282232f8cb66c3106e4958f90688244c44: Status 404 returned error can't find the container with id 7cbf0386abea5fc3f9a3cc38f2b7bd282232f8cb66c3106e4958f90688244c44
Jul 14 15:46:36.960361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.960342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx"
Jul 14 15:46:36.965547 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:36.965409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:36.976548 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:46:36.976529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fa2297_f2cf_4d60_8d8d_9c6668ca3d8c.slice/crio-6101f7afbafa4dac4b0ccac29e85e7174fd23646cc527bdc4504268a5d64ec79 WatchSource:0}: Error finding container 6101f7afbafa4dac4b0ccac29e85e7174fd23646cc527bdc4504268a5d64ec79: Status 404 returned error can't find the container with id 6101f7afbafa4dac4b0ccac29e85e7174fd23646cc527bdc4504268a5d64ec79
Jul 14 15:46:37.333718 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.333638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:37.333718 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.333687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.333745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333838    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333862    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333864    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333875    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333881    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:37.333924 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333927    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:46:38.333908829 +0000 UTC m=+4.079305339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:37.334148 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:46:38.333935564 +0000 UTC m=+4.079332071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:37.334148 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.333961    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:46:38.333952921 +0000 UTC m=+4.079349428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:37.675834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.675732    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:41:36 +0000 UTC" deadline="2027-12-30 05:02:44.262952756 +0000 UTC"
Jul 14 15:46:37.675834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.675791    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12805h16m6.587166515s"
Jul 14 15:46:37.763668 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.763639    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:37.763839 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:37.763765    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:37.775793 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.775765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqgj2" event={"ID":"bf5c31fc-07fc-494a-9f70-e3953cbbfb40","Type":"ContainerStarted","Data":"e817ab8f9291e35b07012015b2c17eea728cc54edbc0853415d998eb9fe362e1"}
Jul 14 15:46:37.778498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.778474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-844v5" event={"ID":"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c","Type":"ContainerStarted","Data":"6101f7afbafa4dac4b0ccac29e85e7174fd23646cc527bdc4504268a5d64ec79"}
Jul 14 15:46:37.784484 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.784458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx" event={"ID":"fb8bff05-2cf4-4158-890a-0e6f36d87559","Type":"ContainerStarted","Data":"6b7a0e596c9644fcf8974328bf9287425bc09d3e9bc1356e34f5f97973c06dd7"}
Jul 14 15:46:37.786622 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.786579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerStarted","Data":"7cbf0386abea5fc3f9a3cc38f2b7bd282232f8cb66c3106e4958f90688244c44"}
Jul 14 15:46:37.798279 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.798253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbbd6" event={"ID":"40d4eb53-5894-4a30-8fd1-709ffc21af97","Type":"ContainerStarted","Data":"ea6bc15c7c14a03a7c4abd4c7bb09f7c4da93bcfa0b0cfb9ce578584da867531"}
Jul 14 15:46:37.802605 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.802564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"7b73634605bbf208021c18e056c30880d2bf19fda23fba07b0e63b4b0566fe16"}
Jul 14 15:46:37.808311 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.808285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbxkv" event={"ID":"6cbdc016-105a-4500-9c29-c0b6786fff34","Type":"ContainerStarted","Data":"a88b905a47821dbf172bccf750ee8926e663f377c819e089b79071b3c163f9cd"}
Jul 14 15:46:37.818635 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.818470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h29dq" event={"ID":"fdf64f5f-e738-49fd-8518-0974f2dc9dbb","Type":"ContainerStarted","Data":"1071b1194e6cc746ff30abca2364e5f07bb9673cee7bf4e0c11f55973bd1597f"}
Jul 14 15:46:37.827845 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:37.827825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qzgh" event={"ID":"50ae58fb-539d-42b7-b173-4712ec46f049","Type":"ContainerStarted","Data":"ae44f83daf4a663c7fcae6107c5c7e2fd7a4fb89146df18789927a2c5c4a3795"}
Jul 14 15:46:38.069897 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.069865    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 15:46:38.341173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.341085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:38.341173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.341143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:38.341173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.341172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:38.341524 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341291    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:38.341524 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341344    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:46:40.341327978 +0000 UTC m=+6.086724486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:38.341738 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341717    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:38.341797 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341778    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:46:40.341761624 +0000 UTC m=+6.087158133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:38.341871 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341856    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:38.341923 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341881    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:38.341923 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341894    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:38.342020 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.341929    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:46:40.341916915 +0000 UTC m=+6.087313419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:38.676144 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.676019    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 15:41:36 +0000 UTC" deadline="2027-12-19 04:54:13.298667868 +0000 UTC"
Jul 14 15:46:38.676144 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.676055    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12541h7m34.622618068s"
Jul 14 15:46:38.764182 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.763699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:38.764182 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.763829    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:38.764629 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.764477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:38.764629 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:38.764576    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:38.838026 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.837313    2564 generic.go:356] "Generic (PLEG): container finished" podID="f142b672a83761a7d0130506f4b7a25f" containerID="22d4133ed7b6a4d65fb95ed62eb8427efa246fbfe27882448dbde66cd6d12ead" exitCode=0
Jul 14 15:46:38.838026 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:38.837351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"f142b672a83761a7d0130506f4b7a25f","Type":"ContainerDied","Data":"22d4133ed7b6a4d65fb95ed62eb8427efa246fbfe27882448dbde66cd6d12ead"}
Jul 14 15:46:39.763256 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:39.763223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:39.763732 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:39.763349    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:40.359511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:40.359570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:40.359613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.359759    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.359817    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:46:44.359798613 +0000 UTC m=+10.105195124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360184    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360229    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:46:44.360214641 +0000 UTC m=+10.105611152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360303    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360335    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360348    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:40.360451 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.360382    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:46:44.360370923 +0000 UTC m=+10.105767432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:40.763765 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:40.763683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:40.764185 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.763811    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:40.764258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:40.764213    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:40.765614 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:40.764304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:41.763101 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:41.763068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:41.763257 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:41.763189    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:42.763709 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:42.763677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:42.764166 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:42.763793    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:42.764166 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:42.763834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:42.764166 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:42.763880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:43.763781 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:43.763733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:43.764227 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:43.763858    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:44.405122 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:44.405091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:44.405257 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:44.405137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:44.405257 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:44.405158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:44.405344 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405255    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:44.405344 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:46:52.405295111 +0000 UTC m=+18.150691617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:44.405652 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405633    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:44.405741 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405678    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:46:52.405666314 +0000 UTC m=+18.151062818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:44.405741 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405733    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:44.405851 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405746    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:44.405851 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405760    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:44.405851 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.405791    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:46:52.405783803 +0000 UTC m=+18.151180308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:44.763910 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:44.763843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:44.764335 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.763919    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:44.764335 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:44.764170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:44.764335 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:44.764232    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:45.763894 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:45.763862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:45.764053 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:45.763979    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:46.763197 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:46.763166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:46.763360 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:46.763298    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:46.763360 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:46.763334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:46.763471 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:46.763393    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:47.763273 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:47.763241    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:47.763665 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:47.763366    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:48.763257 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:48.763219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:48.763404 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:48.763359    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:48.763801 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:48.763424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:48.763801 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:48.763529    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:49.763683 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:49.763643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:49.764053 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:49.763748    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:50.763866 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:50.763393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:50.763866 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:50.763393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:50.763866 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:50.763503    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:50.763866 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:50.763626    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:51.763426 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:51.763395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:51.763661 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:51.763501    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:52.463408 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:52.463376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:52.463421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:52.463449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463548    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463554    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463559    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463620    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463633    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463636    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:08.463612657 +0000 UTC m=+34.209009164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463657    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:47:08.463647641 +0000 UTC m=+34.209044151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:46:52.463919 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.463673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:47:08.463664079 +0000 UTC m=+34.209060584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:46:52.763161 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:52.763089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:52.763333 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:52.763097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:52.763333 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.763221    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:52.763333 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:52.763291    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:53.763473 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:53.763440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:53.763920 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:53.763564    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:54.764216 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:54.764181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:54.764681 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:54.764287    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:54.764681 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:54.764325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:54.764681 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:54.764399    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:55.763891 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:55.763856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:55.764074 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:55.763977    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:56.765847 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.763702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:56.765847 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:56.763830    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:56.765847 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.763907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:56.765847 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:56.763982    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:56.876338 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.876309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" event={"ID":"ec04f0b7858ab684c71a8a77a26f2b63","Type":"ContainerStarted","Data":"493ca7c5518f299cc3a0f2901365e44a836a3c9801a01308ca562e5286d1b0f7"}
Jul 14 15:46:56.884499 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.884425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"f142b672a83761a7d0130506f4b7a25f","Type":"ContainerStarted","Data":"4dd86ad8c42ea15fe30e8ec0450cda5e7fbbab04650652bf8cc3c9e90895d552"}
Jul 14 15:46:56.887638 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.887059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h29dq" event={"ID":"fdf64f5f-e738-49fd-8518-0974f2dc9dbb","Type":"ContainerStarted","Data":"b1a577235beec98f7d80ae425a4515106a0d28221eecaa054f4e642d79c598b8"}
Jul 14 15:46:56.890887 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.890393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqgj2" event={"ID":"bf5c31fc-07fc-494a-9f70-e3953cbbfb40","Type":"ContainerStarted","Data":"b78198b6bc0ea17821288509b9db9cee70273f6fc10d45af45277f0f4a4a5149"}
Jul 14 15:46:56.892533 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.892500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-844v5" event={"ID":"84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c","Type":"ContainerStarted","Data":"6bde9940e78d493b9bbf384f6f07503af49bcb33e5aa65dd06b195c28a3f0778"}
Jul 14 15:46:56.894903 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.894848    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" podStartSLOduration=20.894829833 podStartE2EDuration="20.894829833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:56.894737414 +0000 UTC m=+22.640133931" watchObservedRunningTime="2026-07-14 15:46:56.894829833 +0000 UTC m=+22.640226361"
Jul 14 15:46:56.895774 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.895641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx" event={"ID":"fb8bff05-2cf4-4158-890a-0e6f36d87559","Type":"ContainerStarted","Data":"1ad444b7aff3675a0e853617bfeae123942454cf380e85adbe5d32fd88676067"}
Jul 14 15:46:56.897562 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.897054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerStarted","Data":"71aed2bc60c276e46337ef7ca9b4f8c691f60ebb7fed996987c39b946b2395ad"}
Jul 14 15:46:56.911853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.911812    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-844v5" podStartSLOduration=2.299722679 podStartE2EDuration="21.911798515s" totalImagesPullingTime="19.612075836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:56.911084766 +0000 UTC m=+22.656481294" watchObservedRunningTime="2026-07-14 15:46:56.911798515 +0000 UTC m=+22.657195042"
Jul 14 15:46:56.948641 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.948576    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qqgj2" podStartSLOduration=3.236079631 podStartE2EDuration="22.948558459s" totalImagesPullingTime="19.712478828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:56.930972255 +0000 UTC m=+22.676368781" watchObservedRunningTime="2026-07-14 15:46:56.948558459 +0000 UTC m=+22.693955003"
Jul 14 15:46:56.948751 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:56.948727    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" podStartSLOduration=20.948721676 podStartE2EDuration="20.948721676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:56.948113294 +0000 UTC m=+22.693509820" watchObservedRunningTime="2026-07-14 15:46:56.948721676 +0000 UTC m=+22.694118203"
Jul 14 15:46:57.035439 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.035250    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h29dq" podStartSLOduration=2.325111385 podStartE2EDuration="22.035213533s" totalImagesPullingTime="19.710102148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:56.995061514 +0000 UTC m=+22.740458041" watchObservedRunningTime="2026-07-14 15:46:57.035213533 +0000 UTC m=+22.780610059"
Jul 14 15:46:57.073390 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.073346    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vbbd6" podStartSLOduration=2.389675405 podStartE2EDuration="22.073327784s" totalImagesPullingTime="19.683652379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:57.035513628 +0000 UTC m=+22.780910133" watchObservedRunningTime="2026-07-14 15:46:57.073327784 +0000 UTC m=+22.818724310"
Jul 14 15:46:57.763384 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.763355    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:57.763543 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:57.763467    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:57.904537 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.904505    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="71aed2bc60c276e46337ef7ca9b4f8c691f60ebb7fed996987c39b946b2395ad" exitCode=0
Jul 14 15:46:57.905323 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.904572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"71aed2bc60c276e46337ef7ca9b4f8c691f60ebb7fed996987c39b946b2395ad"}
Jul 14 15:46:57.906244 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.906221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbbd6" event={"ID":"40d4eb53-5894-4a30-8fd1-709ffc21af97","Type":"ContainerStarted","Data":"1cdd5861ca5fdbdbe718a633d9430a12fd90446252389f5759b563730f56971a"}
Jul 14 15:46:57.909361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909341    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"8d7b8db1c826867d887cdbe82d318942dbb01d83b754183a6c8f6815728778a7"}
Jul 14 15:46:57.909460 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909395    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"7a8824c3983db5fe3ee96936d410d42e073e676537695988ee71c295133f337b"}
Jul 14 15:46:57.909460 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"e128485ef445f4f570650a6950b2312a96a6bef347c3371be8735b368bfbdc69"}
Jul 14 15:46:57.909577 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"80c656b21a9fa875b15c6136a2cbb62ebabb61d426c5a1f503d13c5ac3437619"}
Jul 14 15:46:57.909577 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"466e61c75529396963d93711e691815c445792788438a92e1fbb8be43f512b35"}
Jul 14 15:46:57.909577 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.909570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"a73bfe7d528bf1e3a81c4f3d8372352cacfba6cdef4a2ab847a134091a33a199"}
Jul 14 15:46:57.910912 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:57.910881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbxkv" event={"ID":"6cbdc016-105a-4500-9c29-c0b6786fff34","Type":"ContainerStarted","Data":"d8deea0b38a18e2a23912345dab3b647ef30e200b31cc35c0ab6a80c20928590"}
Jul 14 15:46:58.141425 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.141406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:58.142011 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.141994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:58.161939 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.161904    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gbxkv" podStartSLOduration=4.456298596 podStartE2EDuration="24.161889806s" totalImagesPullingTime="19.70559121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:57.953989765 +0000 UTC m=+23.699386291" watchObservedRunningTime="2026-07-14 15:46:58.161889806 +0000 UTC m=+23.907286431"
Jul 14 15:46:58.210999 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.210979    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 15:46:58.688948 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.688827    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T15:46:58.210993216Z","UUID":"68e744dd-887f-4a9c-84dd-d6fca39cb52c","Handler":null,"Name":"","Endpoint":""}
Jul 14 15:46:58.690335 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.690315    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 15:46:58.690464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.690354    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 15:46:58.763175 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.763151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:46:58.763312 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:58.763248    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:46:58.763378 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.763350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:46:58.763474 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:58.763455    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:46:58.914569 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.914529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qzgh" event={"ID":"50ae58fb-539d-42b7-b173-4712ec46f049","Type":"ContainerStarted","Data":"78ff72dc582e337798442302e8d88b30b4d9144e67a550b1a22802f28f66d3be"}
Jul 14 15:46:58.916883 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.916855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx" event={"ID":"fb8bff05-2cf4-4158-890a-0e6f36d87559","Type":"ContainerStarted","Data":"a0391cd6c8e3c2890c3e702e74661debc7afbea28679792fe87b4e5e62400d82"}
Jul 14 15:46:58.917031 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.916992    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:58.917492 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.917473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-844v5"
Jul 14 15:46:58.974273 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:58.974192    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4qzgh" podStartSLOduration=4.273141115 podStartE2EDuration="23.9741803s" totalImagesPullingTime="19.701039185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:58.935650606 +0000 UTC m=+24.681047136" watchObservedRunningTime="2026-07-14 15:46:58.9741803 +0000 UTC m=+24.719576827"
Jul 14 15:46:59.763160 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:59.763136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:46:59.763313 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:46:59.763244    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:46:59.921651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:59.921558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx" event={"ID":"fb8bff05-2cf4-4158-890a-0e6f36d87559","Type":"ContainerStarted","Data":"dca7e0a6ce7fdd33c9afbc6d377c10ae6b16c2badbe8c5f5665e3f20f195ab50"}
Jul 14 15:46:59.925366 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:46:59.925324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"8967c780386634ead271d7e9b2a71f64e112de155deee9728dcf4c0b715337b9"}
Jul 14 15:47:00.763336 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:00.763142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:00.763641 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:00.763233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:00.763641 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:00.763418    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:47:00.763641 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:00.763511    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:47:01.763225 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.763203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:01.763803 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:01.763303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:47:01.935319 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.935219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" event={"ID":"dd127c69-fb56-44f4-b03c-7fa56b6dca05","Type":"ContainerStarted","Data":"4d76b35745597c2496bfd224edfaca37ac52465de907924c1d4cee35a6e198b6"}
Jul 14 15:47:01.935893 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.935643    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:01.935893 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.935734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:01.935893 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.935786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:01.955574 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.955334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:01.956456 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.956436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:01.964580 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.964535    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p9cmx" podStartSLOduration=5.089688098 podStartE2EDuration="26.964518383s" totalImagesPullingTime="21.874830285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:46:59.942674311 +0000 UTC m=+25.688070837" watchObservedRunningTime="2026-07-14 15:47:01.964518383 +0000 UTC m=+27.709914913"
Jul 14 15:47:01.965310 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:01.965274    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd" podStartSLOduration=8.181033252 podStartE2EDuration="27.965266319s" totalImagesPullingTime="19.784233067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:01.964006908 +0000 UTC m=+27.709403431" watchObservedRunningTime="2026-07-14 15:47:01.965266319 +0000 UTC m=+27.710662851"
Jul 14 15:47:02.763848 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:02.763660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:02.764471 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:02.763716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:02.764471 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:02.763964    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:47:02.764471 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:02.764045    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:47:03.763248 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.763225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:03.763332 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:03.763318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:47:03.901870 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.901812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zcj7p"]
Jul 14 15:47:03.902163 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.901927    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:03.902163 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:03.902036    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:47:03.905900 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.905877    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjt5m"]
Jul 14 15:47:03.910544 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.910528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gm7n"]
Jul 14 15:47:03.910659 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.910620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:03.910720 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:03.910698    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:47:03.942488 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.942467    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="c1ece74704a5a000140439c1b5c9844cf6124f7ec7a763eb35efb7c775bc2cb3" exitCode=0
Jul 14 15:47:03.942621 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.942529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:03.942621 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:03.942550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"c1ece74704a5a000140439c1b5c9844cf6124f7ec7a763eb35efb7c775bc2cb3"}
Jul 14 15:47:03.942738 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:03.942638    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:47:04.947634 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:04.947543    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="2115c473aba5f40aebbbe3225deabb66fc3d4966938d50b7222c3d9821ee1dd9" exitCode=0
Jul 14 15:47:04.947956 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:04.947634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"2115c473aba5f40aebbbe3225deabb66fc3d4966938d50b7222c3d9821ee1dd9"}
Jul 14 15:47:05.763217 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:05.763190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:05.763359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:05.763190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:05.763359 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:05.763288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:47:05.763479 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:05.763190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:05.763479 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:05.763364    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:47:05.763566 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:05.763479    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:47:07.763861 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:07.763690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:07.764191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:07.763724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:07.764191 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:07.763934    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjt5m" podUID="bf753e72-f775-424a-b028-bcb77cb3cbca"
Jul 14 15:47:07.764191 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:07.764019    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gm7n" podUID="ed442b70-a240-407b-acf9-d6e76604fa93"
Jul 14 15:47:07.764191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:07.763733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:07.764191 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:07.764087    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zcj7p" podUID="acc19301-6af9-4e33-8ec0-44065de95e6c"
Jul 14 15:47:07.955266 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:07.955238    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="f1c35e2a3cdafe112aca4bb85a75b0172f0e8eb8a866f3a84ffeb6702b673f53" exitCode=0
Jul 14 15:47:07.955402 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:07.955282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"f1c35e2a3cdafe112aca4bb85a75b0172f0e8eb8a866f3a84ffeb6702b673f53"}
Jul 14 15:47:08.485542 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:08.485510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:08.485559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:08.485651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485676    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485703    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485722    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 15:47:08.485745 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485734    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ps5kv for pod openshift-network-diagnostics/network-check-target-cjt5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:47:08.485990 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485752    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 15:47:08.485990 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485734    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs podName:ed442b70-a240-407b-acf9-d6e76604fa93 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:40.485715273 +0000 UTC m=+66.231111783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs") pod "network-metrics-daemon-5gm7n" (UID: "ed442b70-a240-407b-acf9-d6e76604fa93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 15:47:08.485990 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485798    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv podName:bf753e72-f775-424a-b028-bcb77cb3cbca nodeName:}" failed. No retries permitted until 2026-07-14 15:47:40.485778351 +0000 UTC m=+66.231174855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps5kv" (UniqueName: "kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv") pod "network-check-target-cjt5m" (UID: "bf753e72-f775-424a-b028-bcb77cb3cbca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 15:47:08.485990 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:08.485827    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret podName:acc19301-6af9-4e33-8ec0-44065de95e6c nodeName:}" failed. No retries permitted until 2026-07-14 15:47:40.485815992 +0000 UTC m=+66.231212500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret") pod "global-pull-secret-syncer-zcj7p" (UID: "acc19301-6af9-4e33-8ec0-44065de95e6c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 15:47:09.583510 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.583447    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeReady"
Jul 14 15:47:09.583927 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.583551    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 15:47:09.631507 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.631480    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:47:09.633892 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.633874    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.638002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.637169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 15:47:09.638002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.637500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgb8h\""
Jul 14 15:47:09.638002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.637660    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 15:47:09.638002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.637954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 15:47:09.668088 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.668063    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"]
Jul 14 15:47:09.670540 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.670514    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 15:47:09.671884 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.671861    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5pss"]
Jul 14 15:47:09.672014 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.671994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.674508 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.674482    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"]
Jul 14 15:47:09.674715 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.674684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.675738 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.675714    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 14 15:47:09.675844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.675740    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.675844 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.675826    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.675959 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.675942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 14 15:47:09.676041 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.675728    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dzqhg\""
Jul 14 15:47:09.677457 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.677440    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"]
Jul 14 15:47:09.677557 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.677542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.683498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.680139    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-w5rzb"]
Jul 14 15:47:09.683498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.680250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.683498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.682105    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.683498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.683401    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"]
Jul 14 15:47:09.684400 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.684330    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 14 15:47:09.684481 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.684446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.684753 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.684737    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 14 15:47:09.684992 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.684967    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 14 15:47:09.685071 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.684991    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 14 15:47:09.685997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.685980    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4s9xd\""
Jul 14 15:47:09.686390 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.686363    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.686538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.686516    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"]
Jul 14 15:47:09.686665 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.686638    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sstxw\""
Jul 14 15:47:09.686882 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.686863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.687078 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.687060    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.687430 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.687413    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.687854 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.687831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 14 15:47:09.688165 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.688147    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 14 15:47:09.688731 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.688708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"
Jul 14 15:47:09.690872 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.690157    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k8d29\""
Jul 14 15:47:09.690872 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.690461    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.690872 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.690868    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85bb9f745b-g8wmm"]
Jul 14 15:47:09.691062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.690996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.696561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.696534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.696842 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.696820    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.697246 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.697227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6pcn6\""
Jul 14 15:47:09.697544 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.697478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 15:47:09.697651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.697560    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 15:47:09.698876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.698860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:47:09.698994 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.698970    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"]
Jul 14 15:47:09.699084 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.699069    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.699940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.699922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 14 15:47:09.700205 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.699935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.701453    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.701507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5kpxw\""
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.701574    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.701974    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hbz7g\""
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.702219    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.702727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.702671    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.704068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.703976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"
Jul 14 15:47:09.704257 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.704223    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 15:47:09.704825 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.704804    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vqlkt\""
Jul 14 15:47:09.705277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 14 15:47:09.705691 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705632    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"]
Jul 14 15:47:09.705828 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705808    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 14 15:47:09.706017 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705855    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 14 15:47:09.706154 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705865    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"]
Jul 14 15:47:09.706258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.706183    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5pss"]
Jul 14 15:47:09.706258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.706209    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"]
Jul 14 15:47:09.706258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.706236    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bb9f745b-g8wmm"]
Jul 14 15:47:09.706258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.706255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"]
Jul 14 15:47:09.706492 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.706277    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dmhk5"]
Jul 14 15:47:09.706492 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.705903    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.707454 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.707436    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.707545 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.707457    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.707545 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.707509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r2n22\""
Jul 14 15:47:09.707657 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.707606    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 14 15:47:09.707835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.707821    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.709486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.709471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-w5rzb"]
Jul 14 15:47:09.709550 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.709497    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dlb8h"]
Jul 14 15:47:09.709610 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.709579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.712285 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.712264    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"]
Jul 14 15:47:09.712382 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.712300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlb8h"]
Jul 14 15:47:09.712382 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.712375    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:09.714991 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.714974    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 15:47:09.715184 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.714993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 15:47:09.716630 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.716018    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-km4cd\""
Jul 14 15:47:09.716630 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.716250    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 15:47:09.717445 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.717386    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"]
Jul 14 15:47:09.717550 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.717469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9twdb\""
Jul 14 15:47:09.717642 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.717626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 15:47:09.718252 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.717763    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 15:47:09.719191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.719174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmhk5"]
Jul 14 15:47:09.763235 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.763216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:09.763361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.763295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:09.763361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.763321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:09.765795 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.765782    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 15:47:09.765994 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.765978    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 15:47:09.766062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.765993    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zfvj8\""
Jul 14 15:47:09.766062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.765986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt8h7\""
Jul 14 15:47:09.795116 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795187 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-stats-auth\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.795187 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795187 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795187 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792pd\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795314 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8j2w\" (UniqueName: \"kubernetes.io/projected/cfa6ce6d-eb90-4616-b0b1-e76e47c0b809-kube-api-access-t8j2w\") pod \"volume-data-source-validator-78495597f6-98zpf\" (UID: \"cfa6ce6d-eb90-4616-b0b1-e76e47c0b809\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"
Jul 14 15:47:09.795314 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.795314 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4p5p\" (UniqueName: \"kubernetes.io/projected/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-kube-api-access-h4p5p\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.795399 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b87d1aa3-c97f-4472-8a69-60e417372af2-config\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.795399 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.795399 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkcs8\" (UniqueName: \"kubernetes.io/projected/b87d1aa3-c97f-4472-8a69-60e417372af2-kube-api-access-bkcs8\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.795399 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b87d1aa3-c97f-4472-8a69-60e417372af2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.795510 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sp76\" (UniqueName: \"kubernetes.io/projected/034a093b-34ab-4624-abc0-42817775338b-kube-api-access-8sp76\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.795510 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab0686d-01cc-41c6-895e-e2febb797f7d-serving-cert\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.795510 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnplr\" (UniqueName: \"kubernetes.io/projected/4ab0686d-01cc-41c6-895e-e2febb797f7d-kube-api-access-cnplr\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.795614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh5fr\" (UniqueName: \"kubernetes.io/projected/0102c588-daf7-4ed2-ab65-e15f328a7044-kube-api-access-xh5fr\") pod \"network-check-source-869dcfcdcd-cjwq7\" (UID: \"0102c588-daf7-4ed2-ab65-e15f328a7044\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"
Jul 14 15:47:09.795614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmb5\" (UniqueName: \"kubernetes.io/projected/8711b52e-003b-4a47-bb80-b4ba62fe9a71-kube-api-access-ctmb5\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.795614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.795614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-default-certificate\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.795800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.795800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-config\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.795800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7xdd\" (UniqueName: \"kubernetes.io/projected/2468136b-7de7-489b-87de-1c64fdf97409-kube-api-access-s7xdd\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.795800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-snapshots\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.796295 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.795746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2468136b-7de7-489b-87de-1c64fdf97409-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.796295 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8711b52e-003b-4a47-bb80-b4ba62fe9a71-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.796295 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-trusted-ca\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.796295 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-tmp\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-serving-cert\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2468136b-7de7-489b-87de-1c64fdf97409-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc58s\" (UniqueName: \"kubernetes.io/projected/05587a6e-0e40-4a8e-8e00-8565cbe26029-kube-api-access-mc58s\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.797760 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.796832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.897434 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.897434 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4p5p\" (UniqueName: \"kubernetes.io/projected/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-kube-api-access-h4p5p\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.897434 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b87d1aa3-c97f-4472-8a69-60e417372af2-config\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkcs8\" (UniqueName: \"kubernetes.io/projected/b87d1aa3-c97f-4472-8a69-60e417372af2-kube-api-access-bkcs8\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897506    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b87d1aa3-c97f-4472-8a69-60e417372af2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.897559    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.397540509 +0000 UTC m=+36.142937016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.897570    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sp76\" (UniqueName: \"kubernetes.io/projected/034a093b-34ab-4624-abc0-42817775338b-kube-api-access-8sp76\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.897663 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.897661    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.397643787 +0000 UTC m=+36.143040296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:09.898028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc060fc8-03e3-4712-b698-4717088a1ed4-cert\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:09.898028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab0686d-01cc-41c6-895e-e2febb797f7d-serving-cert\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.898028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnplr\" (UniqueName: \"kubernetes.io/projected/4ab0686d-01cc-41c6-895e-e2febb797f7d-kube-api-access-cnplr\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.898028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.897866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh5fr\" (UniqueName: \"kubernetes.io/projected/0102c588-daf7-4ed2-ab65-e15f328a7044-kube-api-access-xh5fr\") pod \"network-check-source-869dcfcdcd-cjwq7\" (UID: \"0102c588-daf7-4ed2-ab65-e15f328a7044\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"
Jul 14 15:47:09.898028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b87d1aa3-c97f-4472-8a69-60e417372af2-config\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmb5\" (UniqueName: \"kubernetes.io/projected/8711b52e-003b-4a47-bb80-b4ba62fe9a71-kube-api-access-ctmb5\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-default-certificate\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.898213    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.898270    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.398253976 +0000 UTC m=+36.143650486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:09.898277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-config\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xdd\" (UniqueName: \"kubernetes.io/projected/2468136b-7de7-489b-87de-1c64fdf97409-kube-api-access-s7xdd\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-snapshots\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2468136b-7de7-489b-87de-1c64fdf97409-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8711b52e-003b-4a47-bb80-b4ba62fe9a71-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-trusted-ca\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnsvs\" (UniqueName: \"kubernetes.io/projected/bc060fc8-03e3-4712-b698-4717088a1ed4-kube-api-access-fnsvs\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-tmp\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-serving-cert\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2468136b-7de7-489b-87de-1c64fdf97409-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.898687 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05764002-7015-4f8b-a63b-a433ff375ad3-tmp-dir\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc58s\" (UniqueName: \"kubernetes.io/projected/05587a6e-0e40-4a8e-8e00-8565cbe26029-kube-api-access-mc58s\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrqkm\" (UniqueName: \"kubernetes.io/projected/05764002-7015-4f8b-a63b-a433ff375ad3-kube-api-access-lrqkm\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-stats-auth\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.898940    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.898992    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.398979256 +0000 UTC m=+36.144375761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-792pd\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05764002-7015-4f8b-a63b-a433ff375ad3-config-volume\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.899200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8j2w\" (UniqueName: \"kubernetes.io/projected/cfa6ce6d-eb90-4616-b0b1-e76e47c0b809-kube-api-access-t8j2w\") pod \"volume-data-source-validator-78495597f6-98zpf\" (UID: \"cfa6ce6d-eb90-4616-b0b1-e76e47c0b809\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"
Jul 14 15:47:09.900195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899370    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-trusted-ca\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.900195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-tmp\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.900195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.899685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.900634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-snapshots\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.900869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.901202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.901298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2468136b-7de7-489b-87de-1c64fdf97409-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.901469    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.901484    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.901523    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.401509218 +0000 UTC m=+36.146905722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:09.901620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.901580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.902075 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.898829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ab0686d-01cc-41c6-895e-e2febb797f7d-config\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.902129 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.902074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.902879 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.902854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8711b52e-003b-4a47-bb80-b4ba62fe9a71-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.902983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.902880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-serving-cert\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.903261 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.903217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.903261 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.903237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab0686d-01cc-41c6-895e-e2febb797f7d-serving-cert\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.903456 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.903434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b87d1aa3-c97f-4472-8a69-60e417372af2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.903662 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.903640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-default-certificate\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.904136 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.904113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.904550 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.904531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2468136b-7de7-489b-87de-1c64fdf97409-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.905140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.905119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-stats-auth\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.912027 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.912007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkcs8\" (UniqueName: \"kubernetes.io/projected/b87d1aa3-c97f-4472-8a69-60e417372af2-kube-api-access-bkcs8\") pod \"service-ca-operator-7695fc6c8c-tnqfs\" (UID: \"b87d1aa3-c97f-4472-8a69-60e417372af2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:09.912756 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.912735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4p5p\" (UniqueName: \"kubernetes.io/projected/01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a-kube-api-access-h4p5p\") pod \"insights-operator-68d9dd94cf-r5pss\" (UID: \"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.915283 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.915239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-792pd\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.915858 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.915373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh5fr\" (UniqueName: \"kubernetes.io/projected/0102c588-daf7-4ed2-ab65-e15f328a7044-kube-api-access-xh5fr\") pod \"network-check-source-869dcfcdcd-cjwq7\" (UID: \"0102c588-daf7-4ed2-ab65-e15f328a7044\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"
Jul 14 15:47:09.917453 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.917343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnplr\" (UniqueName: \"kubernetes.io/projected/4ab0686d-01cc-41c6-895e-e2febb797f7d-kube-api-access-cnplr\") pod \"console-operator-7866497494-w5rzb\" (UID: \"4ab0686d-01cc-41c6-895e-e2febb797f7d\") " pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:09.917453 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.917389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmb5\" (UniqueName: \"kubernetes.io/projected/8711b52e-003b-4a47-bb80-b4ba62fe9a71-kube-api-access-ctmb5\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:09.918138 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.918106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:09.918494 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.918419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7xdd\" (UniqueName: \"kubernetes.io/projected/2468136b-7de7-489b-87de-1c64fdf97409-kube-api-access-s7xdd\") pod \"kube-storage-version-migrator-operator-799cb7f958-8szgb\" (UID: \"2468136b-7de7-489b-87de-1c64fdf97409\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:09.919767 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.919747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc58s\" (UniqueName: \"kubernetes.io/projected/05587a6e-0e40-4a8e-8e00-8565cbe26029-kube-api-access-mc58s\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:09.919853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.919781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8j2w\" (UniqueName: \"kubernetes.io/projected/cfa6ce6d-eb90-4616-b0b1-e76e47c0b809-kube-api-access-t8j2w\") pod \"volume-data-source-validator-78495597f6-98zpf\" (UID: \"cfa6ce6d-eb90-4616-b0b1-e76e47c0b809\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"
Jul 14 15:47:09.923154 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.923134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sp76\" (UniqueName: \"kubernetes.io/projected/034a093b-34ab-4624-abc0-42817775338b-kube-api-access-8sp76\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:09.931744 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.931720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:09.999279 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999260    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss"
Jul 14 15:47:09.999414 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05764002-7015-4f8b-a63b-a433ff375ad3-config-volume\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.999471 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc060fc8-03e3-4712-b698-4717088a1ed4-cert\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:09.999512 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnsvs\" (UniqueName: \"kubernetes.io/projected/bc060fc8-03e3-4712-b698-4717088a1ed4-kube-api-access-fnsvs\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:09.999556 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05764002-7015-4f8b-a63b-a433ff375ad3-tmp-dir\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.999631 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.999631 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrqkm\" (UniqueName: \"kubernetes.io/projected/05764002-7015-4f8b-a63b-a433ff375ad3-kube-api-access-lrqkm\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.999723 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.999681    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:09.999769 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:09.999748    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:10.499731552 +0000 UTC m=+36.245128060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:09.999890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05764002-7015-4f8b-a63b-a433ff375ad3-tmp-dir\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:09.999974 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:09.999959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05764002-7015-4f8b-a63b-a433ff375ad3-config-volume\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:10.001567 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.001545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc060fc8-03e3-4712-b698-4717088a1ed4-cert\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:10.008721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.008704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"
Jul 14 15:47:10.008831 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.008813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrqkm\" (UniqueName: \"kubernetes.io/projected/05764002-7015-4f8b-a63b-a433ff375ad3-kube-api-access-lrqkm\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:10.009068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.009050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnsvs\" (UniqueName: \"kubernetes.io/projected/bc060fc8-03e3-4712-b698-4717088a1ed4-kube-api-access-fnsvs\") pod \"ingress-canary-dlb8h\" (UID: \"bc060fc8-03e3-4712-b698-4717088a1ed4\") " pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:10.015949 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.015916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"
Jul 14 15:47:10.024108 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.024090    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:10.032691 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.032665    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"
Jul 14 15:47:10.034166 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.034146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:10.046122 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.046104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"
Jul 14 15:47:10.056667 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.056649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlb8h"
Jul 14 15:47:10.263646 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.258995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5pss"]
Jul 14 15:47:10.275888 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:10.274629    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f8a8a7_b5f2_4fbd_b6e6_0452c5651f2a.slice/crio-dbad9739c7d50c0ac8fe7857f3df0963ad96dafc8ed0f9ac3bbaca334e14b7d8 WatchSource:0}: Error finding container dbad9739c7d50c0ac8fe7857f3df0963ad96dafc8ed0f9ac3bbaca334e14b7d8: Status 404 returned error can't find the container with id dbad9739c7d50c0ac8fe7857f3df0963ad96dafc8ed0f9ac3bbaca334e14b7d8
Jul 14 15:47:10.310308 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.310277    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs"]
Jul 14 15:47:10.315312 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:10.315283    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87d1aa3_c97f_4472_8a69_60e417372af2.slice/crio-589447d235470e64a9c5b47a08a8af7aee72b8ca60aa846e99501071cda91a06 WatchSource:0}: Error finding container 589447d235470e64a9c5b47a08a8af7aee72b8ca60aa846e99501071cda91a06: Status 404 returned error can't find the container with id 589447d235470e64a9c5b47a08a8af7aee72b8ca60aa846e99501071cda91a06
Jul 14 15:47:10.320240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.320209    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7"]
Jul 14 15:47:10.324166 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.324087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb"]
Jul 14 15:47:10.337004 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.336974    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-w5rzb"]
Jul 14 15:47:10.340987 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:10.340957    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab0686d_01cc_41c6_895e_e2febb797f7d.slice/crio-5b8e84c64497cdb8f2dfdfe2fe957336ae0faa31233261b05499204459198027 WatchSource:0}: Error finding container 5b8e84c64497cdb8f2dfdfe2fe957336ae0faa31233261b05499204459198027: Status 404 returned error can't find the container with id 5b8e84c64497cdb8f2dfdfe2fe957336ae0faa31233261b05499204459198027
Jul 14 15:47:10.383903 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.383877    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf"]
Jul 14 15:47:10.386783 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:10.386727    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa6ce6d_eb90_4616_b0b1_e76e47c0b809.slice/crio-acd35b824c141b6378f8eac8000368e665e3247a9a47648c56fba06dddf30d15 WatchSource:0}: Error finding container acd35b824c141b6378f8eac8000368e665e3247a9a47648c56fba06dddf30d15: Status 404 returned error can't find the container with id acd35b824c141b6378f8eac8000368e665e3247a9a47648c56fba06dddf30d15
Jul 14 15:47:10.399632 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.399604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlb8h"]
Jul 14 15:47:10.403026 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:10.402966    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc060fc8_03e3_4712_b698_4717088a1ed4.slice/crio-cdd1ce9708cc23be5e3812cea53f9942c6fac273769077b79cde8f42e33eb6dc WatchSource:0}: Error finding container cdd1ce9708cc23be5e3812cea53f9942c6fac273769077b79cde8f42e33eb6dc: Status 404 returned error can't find the container with id cdd1ce9708cc23be5e3812cea53f9942c6fac273769077b79cde8f42e33eb6dc
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.405043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.405101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.405132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405188    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.405198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:10.405262 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405206    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405272    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.405254725 +0000 UTC m=+37.150651245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405287    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.405280501 +0000 UTC m=+37.150677006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405294    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405328    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.405326128 +0000 UTC m=+37.150722647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405375    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.405364797 +0000 UTC m=+37.150761308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.405434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:10.405554 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405546    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:10.405913 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.405584    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.405573268 +0000 UTC m=+37.150969790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:10.506499 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.506473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:10.506653 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.506634    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:10.506702 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:10.506695    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:11.506681454 +0000 UTC m=+37.252077959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:10.964697 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.964656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlb8h" event={"ID":"bc060fc8-03e3-4712-b698-4717088a1ed4","Type":"ContainerStarted","Data":"cdd1ce9708cc23be5e3812cea53f9942c6fac273769077b79cde8f42e33eb6dc"}
Jul 14 15:47:10.966325 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.966299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs" event={"ID":"b87d1aa3-c97f-4472-8a69-60e417372af2","Type":"ContainerStarted","Data":"589447d235470e64a9c5b47a08a8af7aee72b8ca60aa846e99501071cda91a06"}
Jul 14 15:47:10.967779 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.967754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf" event={"ID":"cfa6ce6d-eb90-4616-b0b1-e76e47c0b809","Type":"ContainerStarted","Data":"acd35b824c141b6378f8eac8000368e665e3247a9a47648c56fba06dddf30d15"}
Jul 14 15:47:10.969152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.969126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7" event={"ID":"0102c588-daf7-4ed2-ab65-e15f328a7044","Type":"ContainerStarted","Data":"195f9ca82e5d85b9599aa9782d8bee479a8879edda778468b7e3ce910761a9a5"}
Jul 14 15:47:10.970542 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.970496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb" event={"ID":"2468136b-7de7-489b-87de-1c64fdf97409","Type":"ContainerStarted","Data":"cb315782fbed4d45e7545eee82bef6fb3e7f09687dcb9675f1662737561d3ec5"}
Jul 14 15:47:10.971941 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.971916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-w5rzb" event={"ID":"4ab0686d-01cc-41c6-895e-e2febb797f7d","Type":"ContainerStarted","Data":"5b8e84c64497cdb8f2dfdfe2fe957336ae0faa31233261b05499204459198027"}
Jul 14 15:47:10.973073 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:10.973053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss" event={"ID":"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a","Type":"ContainerStarted","Data":"dbad9739c7d50c0ac8fe7857f3df0963ad96dafc8ed0f9ac3bbaca334e14b7d8"}
Jul 14 15:47:11.413496 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.413419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:11.413496 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.413487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:11.413730 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.413529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:11.413730 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.413558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:11.413730 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413633    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:11.413730 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413723    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:11.413927 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413780    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.413761017 +0000 UTC m=+39.159157523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:11.413927 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.413787156 +0000 UTC m=+39.159183678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:11.413927 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413849    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:11.413927 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413862    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:11.413927 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413895    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.41388396 +0000 UTC m=+39.159280486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:11.414237 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.413968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.413957271 +0000 UTC m=+39.159353809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:11.414237 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.414025    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:11.414237 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.414057    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.414047371 +0000 UTC m=+39.159443877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:11.414237 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.413640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:11.514942 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:11.514808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:11.515099 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.514953    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:11.515099 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:11.515008    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:13.514991702 +0000 UTC m=+39.260388217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:13.413170 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.413069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:13.432727 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.432570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:13.432951 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.432921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:13.433062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.432988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:13.433062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.433017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:13.433157 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.433079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.432711    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433276    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.433257162 +0000 UTC m=+43.178653671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433344    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433356    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433391    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.433380245 +0000 UTC m=+43.178776758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433473    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.433461368 +0000 UTC m=+43.178857878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433530    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433558    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.433549103 +0000 UTC m=+43.178945610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433194    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:13.433930 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.433615    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.433585883 +0000 UTC m=+43.178982389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:13.533872 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:13.533845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:13.534002 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.533964    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:13.534053 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:13.534025    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:17.534008262 +0000 UTC m=+43.279404769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:15.154443 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:15.154406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:15.254292 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:15.254255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:17.468903 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.468858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:17.468903 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.468905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469004    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469014    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469019    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.469044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469066    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.469047206 +0000 UTC m=+51.214443712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469086    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.469076898 +0000 UTC m=+51.214473410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.469113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469136    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.469124252 +0000 UTC m=+51.214520773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469172    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469207    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.469197267 +0000 UTC m=+51.214593772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.469201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469257    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:17.469298 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.469286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.469279312 +0000 UTC m=+51.214675818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:17.570394 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:17.570377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:17.570457 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.570449    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:17.570495 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:17.570486    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.570474895 +0000 UTC m=+51.315871400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:20.005314 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.005282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerStarted","Data":"5957940928ab8c8b3d0acdec19a190c2fa16ab381013cc28e4e1e0cfe19fee3d"}
Jul 14 15:47:20.006856 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.006831    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/0.log"
Jul 14 15:47:20.006962 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.006869    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ab0686d-01cc-41c6-895e-e2febb797f7d" containerID="1b35f5a153f79fd192635ad93b85885e915eefe6317ece78cbbb5a298f16a8d1" exitCode=255
Jul 14 15:47:20.007034 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.007003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-w5rzb" event={"ID":"4ab0686d-01cc-41c6-895e-e2febb797f7d","Type":"ContainerDied","Data":"1b35f5a153f79fd192635ad93b85885e915eefe6317ece78cbbb5a298f16a8d1"}
Jul 14 15:47:20.007209 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.007192    2564 scope.go:117] "RemoveContainer" containerID="1b35f5a153f79fd192635ad93b85885e915eefe6317ece78cbbb5a298f16a8d1"
Jul 14 15:47:20.019852 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.018745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlb8h" event={"ID":"bc060fc8-03e3-4712-b698-4717088a1ed4","Type":"ContainerStarted","Data":"b79af204e74ddaad846324571efabde4424b92acae4b61de209359e9797851a0"}
Jul 14 15:47:20.022797 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.022770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs" event={"ID":"b87d1aa3-c97f-4472-8a69-60e417372af2","Type":"ContainerStarted","Data":"4c31204923ace2968552f30574549a67248ccc0265de54d73fb646e7feaa2595"}
Jul 14 15:47:20.024324 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.024237    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:20.024324 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.024285    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:20.025507 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.025477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf" event={"ID":"cfa6ce6d-eb90-4616-b0b1-e76e47c0b809","Type":"ContainerStarted","Data":"a61381c3488574dd8d023cb80d124960ac0ce33540e95d60b6fc6b65d0270b0a"}
Jul 14 15:47:20.029006 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.028981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7" event={"ID":"0102c588-daf7-4ed2-ab65-e15f328a7044","Type":"ContainerStarted","Data":"c6c18876beafb0db320cfeed66767eb530363c8ed97f822c04289e8e79305b1f"}
Jul 14 15:47:20.050381 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.050296    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs" podStartSLOduration=22.025276188 podStartE2EDuration="31.050280992s" totalImagesPullingTime="9.025004804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:20.049880367 +0000 UTC m=+45.795276896" watchObservedRunningTime="2026-07-14 15:47:20.050280992 +0000 UTC m=+45.795677519"
Jul 14 15:47:20.100210 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.098191    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-98zpf" podStartSLOduration=23.944658281 podStartE2EDuration="31.098172187s" totalImagesPullingTime="7.153513906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:20.094096756 +0000 UTC m=+45.839493285" watchObservedRunningTime="2026-07-14 15:47:20.098172187 +0000 UTC m=+45.843568715"
Jul 14 15:47:20.100210 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.099400    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cjwq7" podStartSLOduration=18.68966122 podStartE2EDuration="28.09938489s" totalImagesPullingTime="9.40972367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:20.071379323 +0000 UTC m=+45.816775851" watchObservedRunningTime="2026-07-14 15:47:20.09938489 +0000 UTC m=+45.844781418"
Jul 14 15:47:20.145926 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.136515    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dlb8h" podStartSLOduration=1.8270549 podStartE2EDuration="11.136495658s" totalImagesPullingTime="9.309440758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:20.124322978 +0000 UTC m=+45.869719500" watchObservedRunningTime="2026-07-14 15:47:20.136495658 +0000 UTC m=+45.881892186"
Jul 14 15:47:20.204359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.204044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:20.302856 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.302814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:20.755041 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.755003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:20.854407 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:20.854355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.034770 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.034700    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="5957940928ab8c8b3d0acdec19a190c2fa16ab381013cc28e4e1e0cfe19fee3d" exitCode=0
Jul 14 15:47:21.035161 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.034962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"5957940928ab8c8b3d0acdec19a190c2fa16ab381013cc28e4e1e0cfe19fee3d"}
Jul 14 15:47:21.036626 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.036584    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:47:21.037074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.037046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/0.log"
Jul 14 15:47:21.037153 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.037116    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ab0686d-01cc-41c6-895e-e2febb797f7d" containerID="58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e" exitCode=255
Jul 14 15:47:21.037231 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.037208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-w5rzb" event={"ID":"4ab0686d-01cc-41c6-895e-e2febb797f7d","Type":"ContainerDied","Data":"58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e"}
Jul 14 15:47:21.037353 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.037294    2564 scope.go:117] "RemoveContainer" containerID="1b35f5a153f79fd192635ad93b85885e915eefe6317ece78cbbb5a298f16a8d1"
Jul 14 15:47:21.037608 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.037571    2564 scope.go:117] "RemoveContainer" containerID="58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e"
Jul 14 15:47:21.037796 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:21.037761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-w5rzb_openshift-console-operator(4ab0686d-01cc-41c6-895e-e2febb797f7d)\"" pod="openshift-console-operator/console-operator-7866497494-w5rzb" podUID="4ab0686d-01cc-41c6-895e-e2febb797f7d"
Jul 14 15:47:21.039195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.039172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss" event={"ID":"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a","Type":"ContainerStarted","Data":"03c2a0ae417a34b6ab6cf8f34f4f2c6d8690b9712cd1fff7f93a1d1b3b6048cb"}
Jul 14 15:47:21.041423 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.041395    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb" event={"ID":"2468136b-7de7-489b-87de-1c64fdf97409","Type":"ContainerStarted","Data":"b60bb0b5d854fcf202870f2b04a22432d2f9de5d19487e3833028559f4ddc845"}
Jul 14 15:47:21.054055 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.054025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.102154 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.098928    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss" podStartSLOduration=22.63020821 podStartE2EDuration="32.098909741s" totalImagesPullingTime="9.468701531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:21.07793363 +0000 UTC m=+46.823330158" watchObservedRunningTime="2026-07-14 15:47:21.098909741 +0000 UTC m=+46.844306272"
Jul 14 15:47:21.102154 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.099088    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb" podStartSLOduration=22.690476832 podStartE2EDuration="32.099074862s" totalImagesPullingTime="9.40859803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:21.097858771 +0000 UTC m=+46.843255299" watchObservedRunningTime="2026-07-14 15:47:21.099074862 +0000 UTC m=+46.844471392"
Jul 14 15:47:21.133986 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.133921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.231829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.231798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.347106 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.347041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.352396 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.352367    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l9d5c"]
Jul 14 15:47:21.362046 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.362022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.364372 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.364349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 15:47:21.364613 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.364573    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 15:47:21.364980 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.364957    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lf679\""
Jul 14 15:47:21.401536 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.401514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.401627 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.401553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ea67fd-567a-479e-b689-14bdc30ffd84-data-volume\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.401627 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.401580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8cpq\" (UniqueName: \"kubernetes.io/projected/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-api-access-t8cpq\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.401712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.401644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.401712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.401690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ea67fd-567a-479e-b689-14bdc30ffd84-crio-socket\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.421046 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.421025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9d5c"]
Jul 14 15:47:21.455792 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.455749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.502675 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502791 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ea67fd-567a-479e-b689-14bdc30ffd84-data-volume\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502791 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8cpq\" (UniqueName: \"kubernetes.io/projected/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-api-access-t8cpq\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502791 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:21.502787    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ea67fd-567a-479e-b689-14bdc30ffd84-crio-socket\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:21.502851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:22.002832028 +0000 UTC m=+47.748228533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:21.502848    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.502877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ea67fd-567a-479e-b689-14bdc30ffd84-crio-socket\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.502945 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:21.502894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:22.0028841 +0000 UTC m=+47.748280607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : configmap "kube-rbac-proxy" not found
Jul 14 15:47:21.503296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.503012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ea67fd-567a-479e-b689-14bdc30ffd84-data-volume\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.518048 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.518027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8cpq\" (UniqueName: \"kubernetes.io/projected/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-api-access-t8cpq\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:21.575224 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.575197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.678045 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.678014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:21.979876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:21.979804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:22.008018 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.007983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:22.008166 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:22.008101    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 15:47:22.008166 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.008143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:22.008166 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:22.008152    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:23.008137618 +0000 UTC m=+48.753534124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : configmap "kube-rbac-proxy" not found
Jul 14 15:47:22.008328 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:22.008237    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:22.008328 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:22.008297    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:23.008278418 +0000 UTC m=+48.753674924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:22.045556 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.045535    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:47:22.045957 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.045895    2564 scope.go:117] "RemoveContainer" containerID="58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e"
Jul 14 15:47:22.046046 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:22.046023    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-w5rzb_openshift-console-operator(4ab0686d-01cc-41c6-895e-e2febb797f7d)\"" pod="openshift-console-operator/console-operator-7866497494-w5rzb" podUID="4ab0686d-01cc-41c6-895e-e2febb797f7d"
Jul 14 15:47:22.049966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.049934    2564 generic.go:356] "Generic (PLEG): container finished" podID="970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc" containerID="e9c60ae39ffd9e78311bb0d96124eabc03b6dfa584bf1f49657ff4a272b6a51c" exitCode=0
Jul 14 15:47:22.050102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.049996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerDied","Data":"e9c60ae39ffd9e78311bb0d96124eabc03b6dfa584bf1f49657ff4a272b6a51c"}
Jul 14 15:47:22.070815 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.070791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:22.190173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.190146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:22.339211 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.339152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:22.443925 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.443900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:22.947839 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:22.947815    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbxkv_6cbdc016-105a-4500-9c29-c0b6786fff34/dns-node-resolver/0.log"
Jul 14 15:47:23.019204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.019180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:23.019294 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.019224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:23.019361 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:23.019305    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 15:47:23.019361 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:23.019332    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:23.019446 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:23.019363    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.019349006 +0000 UTC m=+50.764745512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : configmap "kube-rbac-proxy" not found
Jul 14 15:47:23.019446 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:23.019390    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:25.019372671 +0000 UTC m=+50.764769196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:23.057186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.057158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" event={"ID":"970aa2d0-5821-486f-b9a2-ca2b1b9ef8cc","Type":"ContainerStarted","Data":"c407d3ce3da2d83ccf7194b29c4046e7ec2d54dea709c20bae4404c9b8e7449c"}
Jul 14 15:47:23.082712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.082673    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w9q8v" podStartSLOduration=8.239656539 podStartE2EDuration="48.082659722s" totalImagesPullingTime="39.843003183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:23.080765698 +0000 UTC m=+48.826162235" watchObservedRunningTime="2026-07-14 15:47:23.082659722 +0000 UTC m=+48.828056248"
Jul 14 15:47:23.177917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.177877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:23.279103 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:23.279054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:24.148567 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.148540    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbbd6_40d4eb53-5894-4a30-8fd1-709ffc21af97/node-ca/0.log"
Jul 14 15:47:24.432525 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.432495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:24.534316 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.534283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:24.548126 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.548096    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlb8h_bc060fc8-03e3-4712-b698-4717088a1ed4/serve-healthcheck-canary/0.log"
Jul 14 15:47:24.792372 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.792291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:24.893809 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:24.893781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:25.025425 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.025389    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:25.036035 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.036014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:25.036117 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.036058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:25.036179 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.036162    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 15:47:25.036229 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.036196    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:25.036229 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.036224    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:29.036207597 +0000 UTC m=+54.781604104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : configmap "kube-rbac-proxy" not found
Jul 14 15:47:25.036319 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.036268    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:29.03623621 +0000 UTC m=+54.781632716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:25.482694 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.482655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:25.539722 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.539694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:25.539824 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.539729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:25.539824 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.539783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:25.539904 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.539865    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.539847917 +0000 UTC m=+67.285244423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : configmap references non-existent config key: service-ca.crt
Jul 14 15:47:25.539964 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.539912    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 15:47:25.540012 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.539968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs podName:034a093b-34ab-4624-abc0-42817775338b nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.539954329 +0000 UTC m=+67.285350839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs") pod "router-default-85bb9f745b-g8wmm" (UID: "034a093b-34ab-4624-abc0-42817775338b") : secret "router-metrics-certs-default" not found
Jul 14 15:47:25.540012 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.539913    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:25.540012 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.539987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:25.540153 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540045    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls podName:8711b52e-003b-4a47-bb80-b4ba62fe9a71 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.540025222 +0000 UTC m=+67.285421760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rc2n4" (UID: "8711b52e-003b-4a47-bb80-b4ba62fe9a71") : secret "cluster-monitoring-operator-tls" not found
Jul 14 15:47:25.540153 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540050    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 15:47:25.540153 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.540070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:25.540153 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540092    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls podName:05587a6e-0e40-4a8e-8e00-8565cbe26029 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.540079252 +0000 UTC m=+67.285475758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls") pod "cluster-samples-operator-65db858894-pxs8c" (UID: "05587a6e-0e40-4a8e-8e00-8565cbe26029") : secret "samples-operator-tls" not found
Jul 14 15:47:25.540153 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540152    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 15:47:25.540345 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540165    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c7bf8ccd-vm2v5: secret "image-registry-tls" not found
Jul 14 15:47:25.540345 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.540209    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls podName:cfae05a4-545a-44cd-9fc7-278b5e5dafb0 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.540196284 +0000 UTC m=+67.285592831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls") pod "image-registry-56c7bf8ccd-vm2v5" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0") : secret "image-registry-tls" not found
Jul 14 15:47:25.582732 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.582699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:25.640651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.640631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:25.640791 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.640774    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 15:47:25.640854 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:25.640829    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls podName:05764002-7015-4f8b-a63b-a433ff375ad3 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:41.640814697 +0000 UTC m=+67.386211204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls") pod "dns-default-dmhk5" (UID: "05764002-7015-4f8b-a63b-a433ff375ad3") : secret "dns-default-metrics-tls" not found
Jul 14 15:47:25.792722 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.792666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:25.886445 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:25.886416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:26.210368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:26.210318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:26.295275 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:26.295243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:27.345126 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:27.345076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:27.461762 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:27.461735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:27.614016 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:27.613947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:27.777876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:27.777846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:28.223971 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:28.223939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.009807 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.009768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.065759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.065735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:29.065901 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.065782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:29.065948 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:29.065915    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:29.065996 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:29.065983    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls podName:f4ea67fd-567a-479e-b689-14bdc30ffd84 nodeName:}" failed. No retries permitted until 2026-07-14 15:47:37.065965078 +0000 UTC m=+62.811361584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9d5c" (UID: "f4ea67fd-567a-479e-b689-14bdc30ffd84") : secret "insights-runtime-extractor-tls" not found
Jul 14 15:47:29.066378 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.066358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ea67fd-567a-479e-b689-14bdc30ffd84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:29.185659 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.185617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.284331 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.284259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.579159 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.579093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.672264 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.672241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:29.809601 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:29.809575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:30.024449 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.024415    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:30.024798 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.024478    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:30.024869 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.024853    2564 scope.go:117] "RemoveContainer" containerID="58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e"
Jul 14 15:47:30.025021 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:30.025000    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-w5rzb_openshift-console-operator(4ab0686d-01cc-41c6-895e-e2febb797f7d)\"" pod="openshift-console-operator/console-operator-7866497494-w5rzb" podUID="4ab0686d-01cc-41c6-895e-e2febb797f7d"
Jul 14 15:47:30.121712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.121679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:30.229830 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.229801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:30.310977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.310904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:30.836196 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:30.836166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:31.119214 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:31.119125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:31.218897 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:31.218869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:31.319307 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:31.319277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:31.612022 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:31.611995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:32.789870 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:32.789843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:32.892062 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:32.892035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:33.413747 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:33.413721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:33.546153 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:33.546120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:33.812040 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:33.811966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:33.958814 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:33.958792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfsmd"
Jul 14 15:47:34.053718 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:34.053687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:34.213673 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:34.213634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:34.672877 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:34.672852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:35.214712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:35.214676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:35.608697 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:35.608623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:36.019101 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:36.019073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:36.208189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:36.208153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:36.473004 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:36.472977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:36.826623 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:36.826525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:37.130483 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.130423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:37.132855 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.132834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ea67fd-567a-479e-b689-14bdc30ffd84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9d5c\" (UID: \"f4ea67fd-567a-479e-b689-14bdc30ffd84\") " pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:37.204078 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.204050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:37.275895 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.275872    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lf679\""
Jul 14 15:47:37.283417 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.283398    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9d5c"
Jul 14 15:47:37.413310 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.413214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9d5c"]
Jul 14 15:47:37.415785 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:37.415756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ea67fd_567a_479e_b689_14bdc30ffd84.slice/crio-ef502754baad2fc35c22a659293c28b122eef75fbf46283768e20f12228e370e WatchSource:0}: Error finding container ef502754baad2fc35c22a659293c28b122eef75fbf46283768e20f12228e370e: Status 404 returned error can't find the container with id ef502754baad2fc35c22a659293c28b122eef75fbf46283768e20f12228e370e
Jul 14 15:47:37.645817 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.645789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:37.810471 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:37.810401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:38.011850 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:38.011786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:38.110132 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:38.110046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9d5c" event={"ID":"f4ea67fd-567a-479e-b689-14bdc30ffd84","Type":"ContainerStarted","Data":"ef502754baad2fc35c22a659293c28b122eef75fbf46283768e20f12228e370e"}
Jul 14 15:47:40.561714 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.561671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:40.562119 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.561783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:40.562119 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.561839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:40.564532 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.564509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 15:47:40.564830 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.564807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5kv\" (UniqueName: \"kubernetes.io/projected/bf753e72-f775-424a-b028-bcb77cb3cbca-kube-api-access-ps5kv\") pod \"network-check-target-cjt5m\" (UID: \"bf753e72-f775-424a-b028-bcb77cb3cbca\") " pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:40.565316 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.565297    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 15:47:40.575416 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.575388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/acc19301-6af9-4e33-8ec0-44065de95e6c-original-pull-secret\") pod \"global-pull-secret-syncer-zcj7p\" (UID: \"acc19301-6af9-4e33-8ec0-44065de95e6c\") " pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:40.575629 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.575609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed442b70-a240-407b-acf9-d6e76604fa93-metrics-certs\") pod \"network-metrics-daemon-5gm7n\" (UID: \"ed442b70-a240-407b-acf9-d6e76604fa93\") " pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:40.675170 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.675146    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zfvj8\""
Jul 14 15:47:40.680191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.680174    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt8h7\""
Jul 14 15:47:40.682196 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.682173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zcj7p"
Jul 14 15:47:40.683217 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.683197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gm7n"
Jul 14 15:47:40.688413 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.688397    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:40.763849 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:40.763824    2564 scope.go:117] "RemoveContainer" containerID="58cc4525408bd2236da8bc8e5a584beee44beb100ba7f5f4cbfab903965faa4e"
Jul 14 15:47:41.306444 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.306320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zcj7p"]
Jul 14 15:47:41.309074 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:41.309048    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc19301_6af9_4e33_8ec0_44065de95e6c.slice/crio-3fe9e9f3a6cc45df30c6526870eff0f32a57f1f9602c87eab8a5ed1a02aed3d6 WatchSource:0}: Error finding container 3fe9e9f3a6cc45df30c6526870eff0f32a57f1f9602c87eab8a5ed1a02aed3d6: Status 404 returned error can't find the container with id 3fe9e9f3a6cc45df30c6526870eff0f32a57f1f9602c87eab8a5ed1a02aed3d6
Jul 14 15:47:41.327825 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.327799    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gm7n"]
Jul 14 15:47:41.329970 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:41.329938    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded442b70_a240_407b_acf9_d6e76604fa93.slice/crio-63090bc84890a43debf5f482afcc825e52c26d084b4fc6b13797924f8d9706ed WatchSource:0}: Error finding container 63090bc84890a43debf5f482afcc825e52c26d084b4fc6b13797924f8d9706ed: Status 404 returned error can't find the container with id 63090bc84890a43debf5f482afcc825e52c26d084b4fc6b13797924f8d9706ed
Jul 14 15:47:41.527570 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.527544    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjt5m"]
Jul 14 15:47:41.530134 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:41.530115    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf753e72_f775_424a_b028_bcb77cb3cbca.slice/crio-9f935a008380a1f25b753c2f084861550bb236f9f843cd63e78c4b964e10679a WatchSource:0}: Error finding container 9f935a008380a1f25b753c2f084861550bb236f9f843cd63e78c4b964e10679a: Status 404 returned error can't find the container with id 9f935a008380a1f25b753c2f084861550bb236f9f843cd63e78c4b964e10679a
Jul 14 15:47:41.571953 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.571919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:41.572296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.571983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:41.572296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.572035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:41.572296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.572084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:41.572296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.572114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:41.572793 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.572738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/034a093b-34ab-4624-abc0-42817775338b-service-ca-bundle\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:41.574929 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.574910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/034a093b-34ab-4624-abc0-42817775338b-metrics-certs\") pod \"router-default-85bb9f745b-g8wmm\" (UID: \"034a093b-34ab-4624-abc0-42817775338b\") " pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:41.575113 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.575087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8711b52e-003b-4a47-bb80-b4ba62fe9a71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rc2n4\" (UID: \"8711b52e-003b-4a47-bb80-b4ba62fe9a71\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:41.575202 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.575092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"image-registry-56c7bf8ccd-vm2v5\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") " pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:41.575437 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.575417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/05587a6e-0e40-4a8e-8e00-8565cbe26029-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pxs8c\" (UID: \"05587a6e-0e40-4a8e-8e00-8565cbe26029\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:41.673281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.673253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:41.675274 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.675247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05764002-7015-4f8b-a63b-a433ff375ad3-metrics-tls\") pod \"dns-default-dmhk5\" (UID: \"05764002-7015-4f8b-a63b-a433ff375ad3\") " pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:41.748128 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.748106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgb8h\""
Jul 14 15:47:41.756478 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.756463    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:41.792690 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.792627    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dzqhg\""
Jul 14 15:47:41.799934 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.799910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"
Jul 14 15:47:41.837802 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.837586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hbz7g\""
Jul 14 15:47:41.842973 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.842774    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vqlkt\""
Jul 14 15:47:41.846468 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.846189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"
Jul 14 15:47:41.852306 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.852216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:41.855420 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.855244    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-km4cd\""
Jul 14 15:47:41.862466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.862447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:41.925619 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:41.924110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:47:41.944888 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:41.940522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfae05a4_545a_44cd_9fc7_278b5e5dafb0.slice/crio-16ad6ce8d2e1db49a607426358fa6947c4204669bfb025c0409e0957c656e185 WatchSource:0}: Error finding container 16ad6ce8d2e1db49a607426358fa6947c4204669bfb025c0409e0957c656e185: Status 404 returned error can't find the container with id 16ad6ce8d2e1db49a607426358fa6947c4204669bfb025c0409e0957c656e185
Jul 14 15:47:42.000740 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.000664    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4"]
Jul 14 15:47:42.089767 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.089193    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bb9f745b-g8wmm"]
Jul 14 15:47:42.126913 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.126892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmhk5"]
Jul 14 15:47:42.130071 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.130045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zcj7p" event={"ID":"acc19301-6af9-4e33-8ec0-44065de95e6c","Type":"ContainerStarted","Data":"3fe9e9f3a6cc45df30c6526870eff0f32a57f1f9602c87eab8a5ed1a02aed3d6"}
Jul 14 15:47:42.132415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.132389    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" event={"ID":"cfae05a4-545a-44cd-9fc7-278b5e5dafb0","Type":"ContainerStarted","Data":"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"}
Jul 14 15:47:42.132533 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.132446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" event={"ID":"cfae05a4-545a-44cd-9fc7-278b5e5dafb0","Type":"ContainerStarted","Data":"16ad6ce8d2e1db49a607426358fa6947c4204669bfb025c0409e0957c656e185"}
Jul 14 15:47:42.132533 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.132483    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:47:42.134079 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.134053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gm7n" event={"ID":"ed442b70-a240-407b-acf9-d6e76604fa93","Type":"ContainerStarted","Data":"63090bc84890a43debf5f482afcc825e52c26d084b4fc6b13797924f8d9706ed"}
Jul 14 15:47:42.138753 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.138619    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:47:42.138753 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.138702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-w5rzb" event={"ID":"4ab0686d-01cc-41c6-895e-e2febb797f7d","Type":"ContainerStarted","Data":"5499abe34caa5631f0aa0818bcbf28a95f24ff86d8693eef98ada4258dc8469a"}
Jul 14 15:47:42.139432 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.139413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:42.141863 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.141843    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c"]
Jul 14 15:47:42.143348 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.143325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9d5c" event={"ID":"f4ea67fd-567a-479e-b689-14bdc30ffd84","Type":"ContainerStarted","Data":"5c4f1d60f1fc7766505622c64f77258af5df011b1305a04302d5b4a67a19a336"}
Jul 14 15:47:42.145307 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.145246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4" event={"ID":"8711b52e-003b-4a47-bb80-b4ba62fe9a71","Type":"ContainerStarted","Data":"771a137a2c014e2fada6498483d9290b5126409fb87eaa35e5a9bfd2fab61b03"}
Jul 14 15:47:42.147018 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.146998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjt5m" event={"ID":"bf753e72-f775-424a-b028-bcb77cb3cbca","Type":"ContainerStarted","Data":"bc6a71dd22c1472f5e240ee868a6ba9dc53510427d9cfd6d7349f92dbbedba6d"}
Jul 14 15:47:42.147113 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.147032    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjt5m" event={"ID":"bf753e72-f775-424a-b028-bcb77cb3cbca","Type":"ContainerStarted","Data":"9f935a008380a1f25b753c2f084861550bb236f9f843cd63e78c4b964e10679a"}
Jul 14 15:47:42.147358 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.147316    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:47:42.160172 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.159969    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" podStartSLOduration=67.15995435 podStartE2EDuration="1m7.15995435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:42.159920156 +0000 UTC m=+67.905316683" watchObservedRunningTime="2026-07-14 15:47:42.15995435 +0000 UTC m=+67.905350878"
Jul 14 15:47:42.181385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.179784    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cjt5m" podStartSLOduration=68.179768246 podStartE2EDuration="1m8.179768246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:42.178958885 +0000 UTC m=+67.924355413" watchObservedRunningTime="2026-07-14 15:47:42.179768246 +0000 UTC m=+67.925164775"
Jul 14 15:47:42.202891 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.201836    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-w5rzb" podStartSLOduration=44.94830423 podStartE2EDuration="53.201827184s" totalImagesPullingTime="8.253522954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:42.20086846 +0000 UTC m=+67.946264989" watchObservedRunningTime="2026-07-14 15:47:42.201827184 +0000 UTC m=+67.947223711"
Jul 14 15:47:42.900654 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:42.900413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-w5rzb"
Jul 14 15:47:43.115752 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.115712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.155813 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.155664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gm7n" event={"ID":"ed442b70-a240-407b-acf9-d6e76604fa93","Type":"ContainerStarted","Data":"81487f85c70499b6c8f3ec4c84cfaf4a3e8eca7d1b90ac13f38ee0ab4be13000"}
Jul 14 15:47:43.155813 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.155729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gm7n" event={"ID":"ed442b70-a240-407b-acf9-d6e76604fa93","Type":"ContainerStarted","Data":"3b70ab2ea570e0676b08d1899380fe588c52725e9644a2dd3239dc049aa077eb"}
Jul 14 15:47:43.158352 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.158323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c" event={"ID":"05587a6e-0e40-4a8e-8e00-8565cbe26029","Type":"ContainerStarted","Data":"aa694e97bffbbf62f98f8e71ae1bf9a6f9431c2ba795b685cc1570b798a664ed"}
Jul 14 15:47:43.162288 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.162260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9d5c" event={"ID":"f4ea67fd-567a-479e-b689-14bdc30ffd84","Type":"ContainerStarted","Data":"3e8278766041d09a7394cfffad5acba732120352317458c9a2427f5d114d39e4"}
Jul 14 15:47:43.163749 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.163724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhk5" event={"ID":"05764002-7015-4f8b-a63b-a433ff375ad3","Type":"ContainerStarted","Data":"62477c668e9520bb0eb8b5f32319b5757bf3f050090d6768f476b8a538282f82"}
Jul 14 15:47:43.168152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.167706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bb9f745b-g8wmm" event={"ID":"034a093b-34ab-4624-abc0-42817775338b","Type":"ContainerStarted","Data":"b975621474d32deaab5287cc14616a627b3f3290025fb206ef4551d69c1bc259"}
Jul 14 15:47:43.168152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.167745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bb9f745b-g8wmm" event={"ID":"034a093b-34ab-4624-abc0-42817775338b","Type":"ContainerStarted","Data":"f6892e0667675b17f06b2244db7b72ec10dd5bec5eb776b6500fe0aa8e45c810"}
Jul 14 15:47:43.175188 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.175143    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5gm7n" podStartSLOduration=66.735936887 podStartE2EDuration="1m8.175120318s" totalImagesPullingTime="1.439183431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:43.174988038 +0000 UTC m=+68.920384567" watchObservedRunningTime="2026-07-14 15:47:43.175120318 +0000 UTC m=+68.920516848"
Jul 14 15:47:43.185712 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.185672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.197220 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.196153    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85bb9f745b-g8wmm" podStartSLOduration=54.196136096 podStartE2EDuration="54.196136096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:43.195470662 +0000 UTC m=+68.940867189" watchObservedRunningTime="2026-07-14 15:47:43.196136096 +0000 UTC m=+68.941532627"
Jul 14 15:47:43.258902 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.258864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.409370 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.409254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.600933 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.600832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.681498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.681468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.796304 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.796274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:43.852988 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.852920    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:43.855994 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.855958    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:43.899710 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:43.899668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:44.181437 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:44.181381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:44.183139 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:44.183119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85bb9f745b-g8wmm"
Jul 14 15:47:45.038022 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.037917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:45.201133 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.201093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:45.291964 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.291829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:45.623069 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.623005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:45.722371 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.722337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:45.834156 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:45.834126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.170186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.169083    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"]
Jul 14 15:47:47.201781 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.201749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"]
Jul 14 15:47:47.201926 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.201858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.206031 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.206007    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 15:47:47.206168 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.206034    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 15:47:47.206835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.206797    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 15:47:47.206965 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.206946    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h7rf8\""
Jul 14 15:47:47.207048 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.206962    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 15:47:47.256841 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.256811    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-zfc56"]
Jul 14 15:47:47.269961 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.269941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:47:47.277190 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.277000    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 15:47:47.278605 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.278571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zfc56"]
Jul 14 15:47:47.281176 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.281155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tg2jf\""
Jul 14 15:47:47.281430 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.281412    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 15:47:47.304091 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.304019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.327323 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.327300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfg5\" (UniqueName: \"kubernetes.io/projected/741368e3-433d-4106-820d-5ad76bafeacd-kube-api-access-cnfg5\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.327425 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.327344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741368e3-433d-4106-820d-5ad76bafeacd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.411273 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.411234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.428239 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.428181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfg5\" (UniqueName: \"kubernetes.io/projected/741368e3-433d-4106-820d-5ad76bafeacd-kube-api-access-cnfg5\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.428239 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.428221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741368e3-433d-4106-820d-5ad76bafeacd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.428377 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.428267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnlkf\" (UniqueName: \"kubernetes.io/projected/f433972e-5606-4e72-90bb-aaf302ed1296-kube-api-access-lnlkf\") pod \"downloads-68c9cbb497-zfc56\" (UID: \"f433972e-5606-4e72-90bb-aaf302ed1296\") " pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:47:47.430852 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.430833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/741368e3-433d-4106-820d-5ad76bafeacd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.443908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.443888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfg5\" (UniqueName: \"kubernetes.io/projected/741368e3-433d-4106-820d-5ad76bafeacd-kube-api-access-cnfg5\") pod \"managed-serviceaccount-addon-agent-774ff7c484-hmssj\" (UID: \"741368e3-433d-4106-820d-5ad76bafeacd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.517846 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.517801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"
Jul 14 15:47:47.529168 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.529131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnlkf\" (UniqueName: \"kubernetes.io/projected/f433972e-5606-4e72-90bb-aaf302ed1296-kube-api-access-lnlkf\") pod \"downloads-68c9cbb497-zfc56\" (UID: \"f433972e-5606-4e72-90bb-aaf302ed1296\") " pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:47:47.565296 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.565072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.567365 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.567320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnlkf\" (UniqueName: \"kubernetes.io/projected/f433972e-5606-4e72-90bb-aaf302ed1296-kube-api-access-lnlkf\") pod \"downloads-68c9cbb497-zfc56\" (UID: \"f433972e-5606-4e72-90bb-aaf302ed1296\") " pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:47:47.579560 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.579526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:47:47.664526 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.664497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.759746 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.759661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:47.860544 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:47.860506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:49.097933 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.097882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zfc56"]
Jul 14 15:47:49.098688 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:49.098584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf433972e_5606_4e72_90bb_aaf302ed1296.slice/crio-5fb79c3aab1239bb5a19a53f1d472ddf784a17e6c2c1fc5520e74edc654d3b61 WatchSource:0}: Error finding container 5fb79c3aab1239bb5a19a53f1d472ddf784a17e6c2c1fc5520e74edc654d3b61: Status 404 returned error can't find the container with id 5fb79c3aab1239bb5a19a53f1d472ddf784a17e6c2c1fc5520e74edc654d3b61
Jul 14 15:47:49.126383 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.126357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj"]
Jul 14 15:47:49.133537 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:49.133506    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod741368e3_433d_4106_820d_5ad76bafeacd.slice/crio-148bd9b6ba310115da2242645551ea4d802bc622d043564c2acd50ea471498d6 WatchSource:0}: Error finding container 148bd9b6ba310115da2242645551ea4d802bc622d043564c2acd50ea471498d6: Status 404 returned error can't find the container with id 148bd9b6ba310115da2242645551ea4d802bc622d043564c2acd50ea471498d6
Jul 14 15:47:49.205874 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.205802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj" event={"ID":"741368e3-433d-4106-820d-5ad76bafeacd","Type":"ContainerStarted","Data":"148bd9b6ba310115da2242645551ea4d802bc622d043564c2acd50ea471498d6"}
Jul 14 15:47:49.209369 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.209309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zfc56" event={"ID":"f433972e-5606-4e72-90bb-aaf302ed1296","Type":"ContainerStarted","Data":"5fb79c3aab1239bb5a19a53f1d472ddf784a17e6c2c1fc5520e74edc654d3b61"}
Jul 14 15:47:49.211826 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.211793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9d5c" event={"ID":"f4ea67fd-567a-479e-b689-14bdc30ffd84","Type":"ContainerStarted","Data":"3bc6b7f9ac74901a247f1fa8251b9924db6d11a2f1be814ea120bdb30a900046"}
Jul 14 15:47:49.213879 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.213473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4" event={"ID":"8711b52e-003b-4a47-bb80-b4ba62fe9a71","Type":"ContainerStarted","Data":"c7e8ecc5ea2bd56db9314f069e8028e663440ba269416979161bfc6a8ea4027d"}
Jul 14 15:47:49.216237 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.216158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zcj7p" event={"ID":"acc19301-6af9-4e33-8ec0-44065de95e6c","Type":"ContainerStarted","Data":"acfd7f7803cf6f9a0278ecaa4400041e9fb88e9b1a86a8d50668753c1c509d2a"}
Jul 14 15:47:49.218033 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.218016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c" event={"ID":"05587a6e-0e40-4a8e-8e00-8565cbe26029","Type":"ContainerStarted","Data":"a808a44e754f6495a1bb10b60ff04564a0f1eb7bde173e039cd73fe373d788b4"}
Jul 14 15:47:49.219489 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.219436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhk5" event={"ID":"05764002-7015-4f8b-a63b-a433ff375ad3","Type":"ContainerStarted","Data":"cc3e8662c4cae40cfa4b0d9a26ad6ff0165b6d129db5b7d8a89fb9d45b6c8ee6"}
Jul 14 15:47:49.252139 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.251742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l9d5c" podStartSLOduration=16.894825737 podStartE2EDuration="28.251720367s" totalImagesPullingTime="11.35689463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:47:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:49.251413548 +0000 UTC m=+74.996810074" watchObservedRunningTime="2026-07-14 15:47:49.251720367 +0000 UTC m=+74.997116927"
Jul 14 15:47:49.286871 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.286805    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rc2n4" podStartSLOduration=53.394838023 podStartE2EDuration="1m0.286784335s" totalImagesPullingTime="6.891946312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:49.286760431 +0000 UTC m=+75.032156958" watchObservedRunningTime="2026-07-14 15:47:49.286784335 +0000 UTC m=+75.032180863"
Jul 14 15:47:49.315314 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.315259    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c" podStartSLOduration=53.676261098 podStartE2EDuration="1m0.315239555s" totalImagesPullingTime="6.638978457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:49.314952048 +0000 UTC m=+75.060348575" watchObservedRunningTime="2026-07-14 15:47:49.315239555 +0000 UTC m=+75.060636083"
Jul 14 15:47:49.348929 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.348892    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zcj7p" podStartSLOduration=66.748666643 podStartE2EDuration="1m14.348878869s" totalImagesPullingTime="7.600212226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:49.348372757 +0000 UTC m=+75.093769325" watchObservedRunningTime="2026-07-14 15:47:49.348878869 +0000 UTC m=+75.094275432"
Jul 14 15:47:49.445879 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.445849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:49.543955 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.543890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:49.633987 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.633964    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"]
Jul 14 15:47:49.647627 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.647579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:49.660774 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.660756    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"]
Jul 14 15:47:49.660875 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.660838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:49.663538 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.663517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 15:47:49.663835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.663820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bmxws\""
Jul 14 15:47:49.747668 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.747645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kbmcn\" (UID: \"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:49.848518 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:49.848449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kbmcn\" (UID: \"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:49.848659 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:49.848585    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 14 15:47:49.848743 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:47:49.848672    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates podName:eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb nodeName:}" failed. No retries permitted until 2026-07-14 15:47:50.348649656 +0000 UTC m=+76.094046176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-kbmcn" (UID: "eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 14 15:47:50.228154 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.228117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pxs8c" event={"ID":"05587a6e-0e40-4a8e-8e00-8565cbe26029","Type":"ContainerStarted","Data":"4f3637294830ceb079460ec037acb5ad64c6c580d1167054d448808fa7046f2c"}
Jul 14 15:47:50.231725 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.231658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhk5" event={"ID":"05764002-7015-4f8b-a63b-a433ff375ad3","Type":"ContainerStarted","Data":"c4944b45babe8e7b5b3b568d4b53f9eb2d58a042ececa18b4408a29cfd62c22a"}
Jul 14 15:47:50.266981 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.266921    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dmhk5" podStartSLOduration=34.575998655 podStartE2EDuration="41.266900887s" totalImagesPullingTime="6.690902232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:50.259810479 +0000 UTC m=+76.005207007" watchObservedRunningTime="2026-07-14 15:47:50.266900887 +0000 UTC m=+76.012297415"
Jul 14 15:47:50.304750 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.304719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:50.353614 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.352899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kbmcn\" (UID: \"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:50.357897 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.357845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kbmcn\" (UID: \"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:50.569776 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.569693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:50.740747 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:50.740581    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"]
Jul 14 15:47:50.743507 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:47:50.743476    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb90ed0_4f57_4c6e_91ba_ae0d7123bedb.slice/crio-5b55f312021f79a3de9e5f80d3d6d626f64c43be2228f1d7cfc1a2534260f7f7 WatchSource:0}: Error finding container 5b55f312021f79a3de9e5f80d3d6d626f64c43be2228f1d7cfc1a2534260f7f7: Status 404 returned error can't find the container with id 5b55f312021f79a3de9e5f80d3d6d626f64c43be2228f1d7cfc1a2534260f7f7
Jul 14 15:47:51.237640 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:51.237587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn" event={"ID":"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb","Type":"ContainerStarted","Data":"5b55f312021f79a3de9e5f80d3d6d626f64c43be2228f1d7cfc1a2534260f7f7"}
Jul 14 15:47:51.238099 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:51.237963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:47:52.567462 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:52.567430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:52.645006 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:52.644949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:53.248524 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:53.248487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj" event={"ID":"741368e3-433d-4106-820d-5ad76bafeacd","Type":"ContainerStarted","Data":"8463da9613874051e95113505b2e1686c067974e750354a9243022db397083ec"}
Jul 14 15:47:53.267126 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:53.267066    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-774ff7c484-hmssj" podStartSLOduration=2.875058907 podStartE2EDuration="6.267050719s" totalImagesPullingTime="3.391991812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:53.265764352 +0000 UTC m=+79.011160934" watchObservedRunningTime="2026-07-14 15:47:53.267050719 +0000 UTC m=+79.012447246"
Jul 14 15:47:54.254657 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:54.254621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn" event={"ID":"eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb","Type":"ContainerStarted","Data":"86e07f3b3daa8171743317478c9b09d57e484c720c14c5c934aa8a121872d1c7"}
Jul 14 15:47:54.274501 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:54.274451    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn" podStartSLOduration=2.42047568 podStartE2EDuration="5.274431876s" totalImagesPullingTime="2.853956196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:47:54.272699632 +0000 UTC m=+80.018096160" watchObservedRunningTime="2026-07-14 15:47:54.274431876 +0000 UTC m=+80.019828404"
Jul 14 15:47:55.259738 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:55.259704    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:55.264704 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:55.264677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kbmcn"
Jul 14 15:47:55.883366 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:55.883243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:55.947988 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:55.947956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:58.009231 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:58.009199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:58.696020 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:58.695984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:58.794320 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:58.794220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:59.502436 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:59.502383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:47:59.604001 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:47:59.603960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:00.102810 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:00.102773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:00.165606 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:00.165566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:01.244091 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:01.244058    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dmhk5"
Jul 14 15:48:01.266937 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:01.266902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:01.761757 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:01.761715    2564 patch_prober.go:28] interesting pod/image-registry-56c7bf8ccd-vm2v5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 15:48:01.761947 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:01.761777    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 15:48:02.142486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:02.142389    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:02.247263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:02.247225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:02.583482 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:02.583443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:02.646234 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:02.646202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:02.824577 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:02.824548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:03.042721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.042686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:03.091981 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.091950    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p7ztb"]
Jul 14 15:48:03.095305 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.095284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.098554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.098375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 15:48:03.098554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.098445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 15:48:03.099203 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.099181    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 15:48:03.099357 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.099339    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 15:48:03.099771 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.099750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vsgwq\""
Jul 14 15:48:03.150574 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.150545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:03.159669 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-sys\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.159782 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-root\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.159782 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.159782 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-tls\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.160015 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-textfile\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.160015 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-metrics-client-ca\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.160015 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.160015 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.159954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-wtmp\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.172943 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.172922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:48:03.260310 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x62k9\" (UniqueName: \"kubernetes.io/projected/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-kube-api-access-x62k9\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-wtmp\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-sys\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260759 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-root\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-sys\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-tls\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.260983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-wtmp\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261157 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.260969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-root\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261157 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.261050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-textfile\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261157 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.261102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-metrics-client-ca\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261334 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.261308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261442 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.261397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-textfile\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.261619 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.261559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-metrics-client-ca\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.262960 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.262937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.263556 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.263540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-node-exporter-tls\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.362117 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.362028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x62k9\" (UniqueName: \"kubernetes.io/projected/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-kube-api-access-x62k9\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.370743 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.370712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x62k9\" (UniqueName: \"kubernetes.io/projected/6eed6fef-307b-4dc9-97a8-afc146d7f6ab-kube-api-access-x62k9\") pod \"node-exporter-p7ztb\" (UID: \"6eed6fef-307b-4dc9-97a8-afc146d7f6ab\") " pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.406313 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.406289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7ztb"
Jul 14 15:48:03.632778 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.632679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:03.748360 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.748324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:03.835281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:03.835239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:04.070622 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:04.070525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:04.177754 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:04.177721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:04.272330 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:04.272180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:06.272800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:06.272764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:06.378099 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:06.378053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:06.564582 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:06.564481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:06.665421 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:06.665378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:07.203093 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:48:07.203054    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eed6fef_307b_4dc9_97a8_afc146d7f6ab.slice/crio-80f0bd3bcef486f1937ca1e70a9e53a606805fcb20bd16a3182c057a0bf0deb9 WatchSource:0}: Error finding container 80f0bd3bcef486f1937ca1e70a9e53a606805fcb20bd16a3182c057a0bf0deb9: Status 404 returned error can't find the container with id 80f0bd3bcef486f1937ca1e70a9e53a606805fcb20bd16a3182c057a0bf0deb9
Jul 14 15:48:07.311195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:07.311151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7ztb" event={"ID":"6eed6fef-307b-4dc9-97a8-afc146d7f6ab","Type":"ContainerStarted","Data":"80f0bd3bcef486f1937ca1e70a9e53a606805fcb20bd16a3182c057a0bf0deb9"}
Jul 14 15:48:08.209901 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.209864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:08.309204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.309160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:08.317454 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.317411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zfc56" event={"ID":"f433972e-5606-4e72-90bb-aaf302ed1296","Type":"ContainerStarted","Data":"666bfdedc1a8d073f5310ac980f99e49c65126ffeee7d163af4ec5e3bc31ff74"}
Jul 14 15:48:08.317978 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.317620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:48:08.339459 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.339399    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-zfc56" podStartSLOduration=2.855032531 podStartE2EDuration="21.339375356s" totalImagesPullingTime="18.484342825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:48:08.338662571 +0000 UTC m=+94.084059098" watchObservedRunningTime="2026-07-14 15:48:08.339375356 +0000 UTC m=+94.084771884"
Jul 14 15:48:08.339711 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.339582    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-zfc56"
Jul 14 15:48:08.419522 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:08.419482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:09.536689 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:09.536646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:10.276370 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.276327    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:48:10.304152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.304112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:48:10.304327 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.304258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.307413 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.307389    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 15:48:10.307536 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.307429    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 15:48:10.307536 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.307454    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 15:48:10.308265 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.308243    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 15:48:10.308438 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.308417    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qvsqv\""
Jul 14 15:48:10.308545 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.308415    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 15:48:10.314971 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.314952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 15:48:10.329320 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.329281    2564 generic.go:356] "Generic (PLEG): container finished" podID="6eed6fef-307b-4dc9-97a8-afc146d7f6ab" containerID="f32ee7229e5d50d648aa0f4d572d92278fe88626fab26c76161ba9c259d20e34" exitCode=0
Jul 14 15:48:10.329427 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.329322    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7ztb" event={"ID":"6eed6fef-307b-4dc9-97a8-afc146d7f6ab","Type":"ContainerDied","Data":"f32ee7229e5d50d648aa0f4d572d92278fe88626fab26c76161ba9c259d20e34"}
Jul 14 15:48:10.420641 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.420767 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.420829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.420829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljz6\" (UniqueName: \"kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.420918 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.420918 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.420862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.421251 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.421165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.476035 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.475995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:10.521908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.521864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.521918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljz6\" (UniqueName: \"kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.521955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.521988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.522036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.522066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.522096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.522885 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.522858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.524272 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.523939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.524528 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.524397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.524528 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.524455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.526661 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.526252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.527359 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.527340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.543678 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.543573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljz6\" (UniqueName: \"kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6\") pod \"console-fdc78d578-5slmg\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") " pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.561230 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.561152    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:48:10.617693 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.617664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:10.673522 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.673483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:10.786039 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.785959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:10.799992 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.799964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:48:10.804212 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:48:10.804183    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62dbd5f_be05_4be4_ae25_21aed4071869.slice/crio-f8a69dc9b26cde3ef4d8d208fd371b897f9a256613c6251279be1a2e55fc5f3b WatchSource:0}: Error finding container f8a69dc9b26cde3ef4d8d208fd371b897f9a256613c6251279be1a2e55fc5f3b: Status 404 returned error can't find the container with id f8a69dc9b26cde3ef4d8d208fd371b897f9a256613c6251279be1a2e55fc5f3b
Jul 14 15:48:10.873647 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:10.873614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:11.336719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:11.336683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7ztb" event={"ID":"6eed6fef-307b-4dc9-97a8-afc146d7f6ab","Type":"ContainerStarted","Data":"49895cfce6e5be8f31b1b581e18691ba9e0d8be6d34b1b09d32ea9331a888581"}
Jul 14 15:48:11.336995 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:11.336741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7ztb" event={"ID":"6eed6fef-307b-4dc9-97a8-afc146d7f6ab","Type":"ContainerStarted","Data":"e1a00745c8f492efe1d01733ac9222bdfd3f20c4c4d1b90bf98edec96e468230"}
Jul 14 15:48:11.338256 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:11.338228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc78d578-5slmg" event={"ID":"c62dbd5f-be05-4be4-ae25-21aed4071869","Type":"ContainerStarted","Data":"f8a69dc9b26cde3ef4d8d208fd371b897f9a256613c6251279be1a2e55fc5f3b"}
Jul 14 15:48:11.360277 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:11.360224    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p7ztb" podStartSLOduration=5.628572439 podStartE2EDuration="8.360205058s" totalImagesPullingTime="2.620644451s" totalInitContainerRuntime="110.988168ms" isStatefulPod=true podCreationTimestamp="2026-07-14 15:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:48:11.35802724 +0000 UTC m=+97.103423782" watchObservedRunningTime="2026-07-14 15:48:11.360205058 +0000 UTC m=+97.105601586"
Jul 14 15:48:13.012263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:13.012182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:13.080780 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:13.080723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:14.184994 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:14.184167    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cjt5m"
Jul 14 15:48:14.330509 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:14.330467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:14.461879 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:14.461709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:14.636168 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:14.636131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:14.736566 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:14.736471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:15.366869 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:15.366371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc78d578-5slmg" event={"ID":"c62dbd5f-be05-4be4-ae25-21aed4071869","Type":"ContainerStarted","Data":"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"}
Jul 14 15:48:15.389424 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:15.389372    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdc78d578-5slmg" podStartSLOduration=1.052858781 podStartE2EDuration="5.389358877s" totalImagesPullingTime="4.336500096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:48:15.387566306 +0000 UTC m=+101.132962832" watchObservedRunningTime="2026-07-14 15:48:15.389358877 +0000 UTC m=+101.134755403"
Jul 14 15:48:15.593806 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:15.593759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:15.695339 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:15.695286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:20.618678 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:20.618632    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:20.619102 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:20.618704    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:20.623548 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:20.623526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:20.658035 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:20.658001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:20.727388 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:20.727356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:21.393926 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:21.393903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:48:21.585789 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:21.585758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:21.688305 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:21.688281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:21.787069 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:21.787038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:26.300473 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:26.300428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:26.376814 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:26.376779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:30.108269 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:30.108234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:30.182937 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:30.182904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:35.586959 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:35.586886    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerName="registry" containerID="cri-o://1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31" gracePeriod=30
Jul 14 15:48:35.868041 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:35.868018    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:48:36.016710 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016855 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016855 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016763    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-792pd\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.016977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.016961    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.017175 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.017030    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") pod \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\" (UID: \"cfae05a4-545a-44cd-9fc7-278b5e5dafb0\") "
Jul 14 15:48:36.017175 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.017142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:48:36.017284 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.017263    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-trusted-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.017528 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.017492    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:48:36.019975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.019943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:48:36.020110 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.020082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:48:36.020204 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.020181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd" (OuterVolumeSpecName: "kube-api-access-792pd") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "kube-api-access-792pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:48:36.020285 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.020265    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:48:36.020331 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.020294    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:48:36.025341 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.025317    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cfae05a4-545a-44cd-9fc7-278b5e5dafb0" (UID: "cfae05a4-545a-44cd-9fc7-278b5e5dafb0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117811    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-image-registry-private-configuration\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117832    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-installation-pull-secrets\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117841    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-792pd\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-kube-api-access-792pd\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117849    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-bound-sa-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117857    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-tls\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.117862 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117865    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-registry-certificates\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.118086 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.117873    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfae05a4-545a-44cd-9fc7-278b5e5dafb0-ca-trust-extracted\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:48:36.447349 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.447319    2564 generic.go:356] "Generic (PLEG): container finished" podID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerID="1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31" exitCode=0
Jul 14 15:48:36.447486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.447373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" event={"ID":"cfae05a4-545a-44cd-9fc7-278b5e5dafb0","Type":"ContainerDied","Data":"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"}
Jul 14 15:48:36.447486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.447419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5" event={"ID":"cfae05a4-545a-44cd-9fc7-278b5e5dafb0","Type":"ContainerDied","Data":"16ad6ce8d2e1db49a607426358fa6947c4204669bfb025c0409e0957c656e185"}
Jul 14 15:48:36.447486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.447441    2564 scope.go:117] "RemoveContainer" containerID="1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"
Jul 14 15:48:36.447486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.447378    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"
Jul 14 15:48:36.456484 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.456463    2564 scope.go:117] "RemoveContainer" containerID="1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"
Jul 14 15:48:36.456860 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:48:36.456835    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31\": container with ID starting with 1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31 not found: ID does not exist" containerID="1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"
Jul 14 15:48:36.456967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.456866    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31"} err="failed to get container status \"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31\": rpc error: code = NotFound desc = could not find container \"1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31\": container with ID starting with 1540d7a18ad2679eaa820355dc330e416d548ec8f69064d690c8fb457580ad31 not found: ID does not exist"
Jul 14 15:48:36.468346 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.468323    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:48:36.472786 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.472763    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56c7bf8ccd-vm2v5"]
Jul 14 15:48:36.767773 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:36.767706    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" path="/var/lib/kubelet/pods/cfae05a4-545a-44cd-9fc7-278b5e5dafb0/volumes"
Jul 14 15:48:41.468784 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:41.468751    2564 generic.go:356] "Generic (PLEG): container finished" podID="b87d1aa3-c97f-4472-8a69-60e417372af2" containerID="4c31204923ace2968552f30574549a67248ccc0265de54d73fb646e7feaa2595" exitCode=0
Jul 14 15:48:41.469208 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:41.468828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs" event={"ID":"b87d1aa3-c97f-4472-8a69-60e417372af2","Type":"ContainerDied","Data":"4c31204923ace2968552f30574549a67248ccc0265de54d73fb646e7feaa2595"}
Jul 14 15:48:41.469208 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:41.469121    2564 scope.go:117] "RemoveContainer" containerID="4c31204923ace2968552f30574549a67248ccc0265de54d73fb646e7feaa2595"
Jul 14 15:48:41.945421 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:41.945343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:42.045603 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:42.045554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:42.474990 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:42.474955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tnqfs" event={"ID":"b87d1aa3-c97f-4472-8a69-60e417372af2","Type":"ContainerStarted","Data":"acb15d72ef052cfa305b717e55517db07bc8c3b006a77a2f5ed7c4e1e80baa56"}
Jul 14 15:48:46.492634 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:46.492573    2564 generic.go:356] "Generic (PLEG): container finished" podID="01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a" containerID="03c2a0ae417a34b6ab6cf8f34f4f2c6d8690b9712cd1fff7f93a1d1b3b6048cb" exitCode=0
Jul 14 15:48:46.493065 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:46.492652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss" event={"ID":"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a","Type":"ContainerDied","Data":"03c2a0ae417a34b6ab6cf8f34f4f2c6d8690b9712cd1fff7f93a1d1b3b6048cb"}
Jul 14 15:48:46.493065 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:46.492984    2564 scope.go:117] "RemoveContainer" containerID="03c2a0ae417a34b6ab6cf8f34f4f2c6d8690b9712cd1fff7f93a1d1b3b6048cb"
Jul 14 15:48:47.498524 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:47.498489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5pss" event={"ID":"01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a","Type":"ContainerStarted","Data":"4dd9108c98fef9b097821fdd5cecb9b2b8c04637393db9bb2b863204ec632cdf"}
Jul 14 15:48:51.514504 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:51.514471    2564 generic.go:356] "Generic (PLEG): container finished" podID="2468136b-7de7-489b-87de-1c64fdf97409" containerID="b60bb0b5d854fcf202870f2b04a22432d2f9de5d19487e3833028559f4ddc845" exitCode=0
Jul 14 15:48:51.514889 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:51.514544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb" event={"ID":"2468136b-7de7-489b-87de-1c64fdf97409","Type":"ContainerDied","Data":"b60bb0b5d854fcf202870f2b04a22432d2f9de5d19487e3833028559f4ddc845"}
Jul 14 15:48:51.514950 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:51.514892    2564 scope.go:117] "RemoveContainer" containerID="b60bb0b5d854fcf202870f2b04a22432d2f9de5d19487e3833028559f4ddc845"
Jul 14 15:48:52.214427 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:52.214393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:48:52.526121 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:48:52.526042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8szgb" event={"ID":"2468136b-7de7-489b-87de-1c64fdf97409","Type":"ContainerStarted","Data":"462e7e63e87ba58a5f6802444753b2d730b4c65a440bf6d093cab53081740d69"}
Jul 14 15:49:22.710408 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:22.710373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:23.147068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:23.146984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:31.740846 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.740759    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:49:31.741205 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.741072    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerName="registry"
Jul 14 15:49:31.741205 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.741085    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerName="registry"
Jul 14 15:49:31.741205 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.741139    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfae05a4-545a-44cd-9fc7-278b5e5dafb0" containerName="registry"
Jul 14 15:49:31.743329 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.743301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.760344 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.760322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:49:31.806544 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806680 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806680 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806680 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806680 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.806812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.806729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbnh\" (UniqueName: \"kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.808517 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.808489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:31.876497 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.876471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:31.907317 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbnh\" (UniqueName: \"kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.907618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.907442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.908253 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.908229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.908350 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.908332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.908407 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.908345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.908581 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.908556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.909981 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.909953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.910070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.910026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:31.916795 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:31.916778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbnh\" (UniqueName: \"kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh\") pod \"console-7b8f646774-s7bv6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") " pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:32.053610 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:32.053524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:32.190848 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:32.190825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:49:32.192779 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:49:32.192752    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a58ab13_7d9b_49f0_bf84_ab19232122b6.slice/crio-aaa60e4de2d15934bc03ef995c3d5f6b1c9ac37d0566869f4637c8a60c9fd0da WatchSource:0}: Error finding container aaa60e4de2d15934bc03ef995c3d5f6b1c9ac37d0566869f4637c8a60c9fd0da: Status 404 returned error can't find the container with id aaa60e4de2d15934bc03ef995c3d5f6b1c9ac37d0566869f4637c8a60c9fd0da
Jul 14 15:49:32.691511 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:32.691471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f646774-s7bv6" event={"ID":"3a58ab13-7d9b-49f0-bf84-ab19232122b6","Type":"ContainerStarted","Data":"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"}
Jul 14 15:49:32.691725 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:32.691533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f646774-s7bv6" event={"ID":"3a58ab13-7d9b-49f0-bf84-ab19232122b6","Type":"ContainerStarted","Data":"aaa60e4de2d15934bc03ef995c3d5f6b1c9ac37d0566869f4637c8a60c9fd0da"}
Jul 14 15:49:32.714343 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:32.714285    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b8f646774-s7bv6" podStartSLOduration=1.714263879 podStartE2EDuration="1.714263879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:49:32.713763157 +0000 UTC m=+178.459159685" watchObservedRunningTime="2026-07-14 15:49:32.714263879 +0000 UTC m=+178.459660407"
Jul 14 15:49:41.920506 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:41.920466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:41.992020 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:41.991975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:42.054464 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.054437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:42.054627 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.054484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:42.059336 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.059311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:42.739804 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.739778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:49:42.789824 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.789792    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:49:42.933477 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:42.933426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:43.046150 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:43.046073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:49:43.120496 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:49:43.120460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:07.816757 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:07.816686    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdc78d578-5slmg" podUID="c62dbd5f-be05-4be4-ae25-21aed4071869" containerName="console" containerID="cri-o://2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294" gracePeriod=15
Jul 14 15:50:08.058718 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.058696    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:50:08.164532 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164509    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164628    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bljz6\" (UniqueName: \"kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164664    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164851 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.164851 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert\") pod \"c62dbd5f-be05-4be4-ae25-21aed4071869\" (UID: \"c62dbd5f-be05-4be4-ae25-21aed4071869\") "
Jul 14 15:50:08.165071 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.164976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:50:08.165202 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.165168    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:50:08.165268 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.165183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca" (OuterVolumeSpecName: "service-ca") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:50:08.165354 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.165228    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config" (OuterVolumeSpecName: "console-config") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:50:08.167007 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.166979    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:50:08.167007 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.166996    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:50:08.167127 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.167009    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6" (OuterVolumeSpecName: "kube-api-access-bljz6") pod "c62dbd5f-be05-4be4-ae25-21aed4071869" (UID: "c62dbd5f-be05-4be4-ae25-21aed4071869"). InnerVolumeSpecName "kube-api-access-bljz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:50:08.265706 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265685    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265706 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265706    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bljz6\" (UniqueName: \"kubernetes.io/projected/c62dbd5f-be05-4be4-ae25-21aed4071869-kube-api-access-bljz6\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265718    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265728    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265736    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265745    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c62dbd5f-be05-4be4-ae25-21aed4071869-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.265829 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.265753    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62dbd5f-be05-4be4-ae25-21aed4071869-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:50:08.836008 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.835973    2564 generic.go:356] "Generic (PLEG): container finished" podID="c62dbd5f-be05-4be4-ae25-21aed4071869" containerID="2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294" exitCode=0
Jul 14 15:50:08.836415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.836016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc78d578-5slmg" event={"ID":"c62dbd5f-be05-4be4-ae25-21aed4071869","Type":"ContainerDied","Data":"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"}
Jul 14 15:50:08.836415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.836033    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc78d578-5slmg"
Jul 14 15:50:08.836415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.836053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc78d578-5slmg" event={"ID":"c62dbd5f-be05-4be4-ae25-21aed4071869","Type":"ContainerDied","Data":"f8a69dc9b26cde3ef4d8d208fd371b897f9a256613c6251279be1a2e55fc5f3b"}
Jul 14 15:50:08.836415 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.836075    2564 scope.go:117] "RemoveContainer" containerID="2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"
Jul 14 15:50:08.845340 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.845314    2564 scope.go:117] "RemoveContainer" containerID="2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"
Jul 14 15:50:08.845677 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:50:08.845651    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294\": container with ID starting with 2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294 not found: ID does not exist" containerID="2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"
Jul 14 15:50:08.845746 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.845685    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294"} err="failed to get container status \"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294\": rpc error: code = NotFound desc = could not find container \"2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294\": container with ID starting with 2e9f928f985ba956e8dc833c9f0c9cb55041da58824ffae5a5df2a95a55e8294 not found: ID does not exist"
Jul 14 15:50:08.853016 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.852991    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:50:08.857182 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:08.857159    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdc78d578-5slmg"]
Jul 14 15:50:10.768218 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:10.768177    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62dbd5f-be05-4be4-ae25-21aed4071869" path="/var/lib/kubelet/pods/c62dbd5f-be05-4be4-ae25-21aed4071869/volumes"
Jul 14 15:50:22.135454 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:22.135418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:22.213157 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:22.213128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:35.827644 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:35.827582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:37.882914 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:37.882879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:37.957669 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:37.957636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:39.316654 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.316616    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:50:39.317048 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.316930    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62dbd5f-be05-4be4-ae25-21aed4071869" containerName="console"
Jul 14 15:50:39.317048 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.316948    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62dbd5f-be05-4be4-ae25-21aed4071869" containerName="console"
Jul 14 15:50:39.317048 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.317032    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62dbd5f-be05-4be4-ae25-21aed4071869" containerName="console"
Jul 14 15:50:39.322571 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.322539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.330996 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.330970    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:50:39.377095 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377203 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377203 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377203 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377333 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377333 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.377333 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.377267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtqv\" (UniqueName: \"kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477781 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.477890 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.477884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtqv\" (UniqueName: \"kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.478616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.478562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.478723 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.478562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.478859 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.478838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.478917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.478873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.480319 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.480301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.480503 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.480483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.487065 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.487047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtqv\" (UniqueName: \"kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv\") pod \"console-d6b67cf57-w7rvq\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") " pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.633354 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.633291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:39.763439 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.763415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:50:39.765950 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:50:39.765924    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc9bccc_1242_4721_9def_828389467b4e.slice/crio-c05c059db7a09e6ef11531cc7a10cafbd52e5ae1e052069a2e446ef3c00b3610 WatchSource:0}: Error finding container c05c059db7a09e6ef11531cc7a10cafbd52e5ae1e052069a2e446ef3c00b3610: Status 404 returned error can't find the container with id c05c059db7a09e6ef11531cc7a10cafbd52e5ae1e052069a2e446ef3c00b3610
Jul 14 15:50:39.905368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.905290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:39.967777 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.967744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b67cf57-w7rvq" event={"ID":"1dc9bccc-1242-4721-9def-828389467b4e","Type":"ContainerStarted","Data":"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"}
Jul 14 15:50:39.967919 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.967792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b67cf57-w7rvq" event={"ID":"1dc9bccc-1242-4721-9def-828389467b4e","Type":"ContainerStarted","Data":"c05c059db7a09e6ef11531cc7a10cafbd52e5ae1e052069a2e446ef3c00b3610"}
Jul 14 15:50:39.968299 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.968272    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:39.986059 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:39.986002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6b67cf57-w7rvq" podStartSLOduration=0.98598723 podStartE2EDuration="985.98723ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:50:39.985100588 +0000 UTC m=+245.730497309" watchObservedRunningTime="2026-07-14 15:50:39.98598723 +0000 UTC m=+245.731383756"
Jul 14 15:50:49.634196 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:49.634165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:49.634677 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:49.634240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:49.639015 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:49.638989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:49.812513 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:49.812477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:49.883671 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:49.883643    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:50.012058 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:50.012031    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:50:50.087008 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:50.086973    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:50:50.190576 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:50.190544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:50.292064 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:50.291985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:50:50.375647 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:50:50.375617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:51:00.117936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:00.117851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:51:00.218105 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:00.218078    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:51:15.115186 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.115151    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b8f646774-s7bv6" podUID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" containerName="console" containerID="cri-o://8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550" gracePeriod=15
Jul 14 15:51:15.352604 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.352570    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:51:15.517235 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517212    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517244    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517263    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517361 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517555 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517555 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnbnh\" (UniqueName: \"kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh\") pod \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\" (UID: \"3a58ab13-7d9b-49f0-bf84-ab19232122b6\") "
Jul 14 15:51:15.517708 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517684    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:51:15.517766 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517711    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config" (OuterVolumeSpecName: "console-config") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:51:15.517766 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517758    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.517870 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:51:15.517952 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.517932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:51:15.519535 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.519512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:51:15.519650 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.519535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:51:15.519650 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.519568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh" (OuterVolumeSpecName: "kube-api-access-xnbnh") pod "3a58ab13-7d9b-49f0-bf84-ab19232122b6" (UID: "3a58ab13-7d9b-49f0-bf84-ab19232122b6"). InnerVolumeSpecName "kube-api-access-xnbnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:51:15.618436 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618410    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.618436 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618438    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.618436 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618448    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.618618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618456    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a58ab13-7d9b-49f0-bf84-ab19232122b6-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.618618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618465    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a58ab13-7d9b-49f0-bf84-ab19232122b6-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:15.618618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:15.618473    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnbnh\" (UniqueName: \"kubernetes.io/projected/3a58ab13-7d9b-49f0-bf84-ab19232122b6-kube-api-access-xnbnh\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:51:16.101644 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.101617    2564 generic.go:356] "Generic (PLEG): container finished" podID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" containerID="8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550" exitCode=0
Jul 14 15:51:16.101745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.101666    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f646774-s7bv6"
Jul 14 15:51:16.101745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.101681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f646774-s7bv6" event={"ID":"3a58ab13-7d9b-49f0-bf84-ab19232122b6","Type":"ContainerDied","Data":"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"}
Jul 14 15:51:16.101812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.101764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f646774-s7bv6" event={"ID":"3a58ab13-7d9b-49f0-bf84-ab19232122b6","Type":"ContainerDied","Data":"aaa60e4de2d15934bc03ef995c3d5f6b1c9ac37d0566869f4637c8a60c9fd0da"}
Jul 14 15:51:16.101812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.101789    2564 scope.go:117] "RemoveContainer" containerID="8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"
Jul 14 15:51:16.109977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.109959    2564 scope.go:117] "RemoveContainer" containerID="8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"
Jul 14 15:51:16.110204 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:51:16.110189    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550\": container with ID starting with 8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550 not found: ID does not exist" containerID="8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"
Jul 14 15:51:16.110247 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.110211    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550"} err="failed to get container status \"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550\": rpc error: code = NotFound desc = could not find container \"8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550\": container with ID starting with 8e648addeb4daf4a2976feb1be22f2dd25e1a23834e9460d741644967e3ee550 not found: ID does not exist"
Jul 14 15:51:16.123401 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.123383    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:51:16.128656 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.128637    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8f646774-s7bv6"]
Jul 14 15:51:16.767303 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:16.767280    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" path="/var/lib/kubelet/pods/3a58ab13-7d9b-49f0-bf84-ab19232122b6/volumes"
Jul 14 15:51:22.891770 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:22.891733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:51:34.621886 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:34.621858    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:51:34.623801 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:34.623780    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:51:34.633171 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:51:34.633151    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 15:52:04.047023 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.046983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:04.733063 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.733033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"]
Jul 14 15:52:04.733333 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.733321    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" containerName="console"
Jul 14 15:52:04.733374 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.733334    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" containerName="console"
Jul 14 15:52:04.733407 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.733390    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a58ab13-7d9b-49f0-bf84-ab19232122b6" containerName="console"
Jul 14 15:52:04.735500 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.735475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.738036 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.738016    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 15:52:04.738461 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.738448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 15:52:04.739036 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.739020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prqvp\""
Jul 14 15:52:04.740833 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.740800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffk2w\" (UniqueName: \"kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.740931 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.740866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.740931 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.740895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.753166 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.753142    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"]
Jul 14 15:52:04.842067 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.842037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.842067 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.842071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.842275 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.842111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffk2w\" (UniqueName: \"kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.842451 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.842429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.842507 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.842433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:04.851498 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:04.851475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffk2w\" (UniqueName: \"kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:05.045311 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:05.045218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:05.177118 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:05.177076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"]
Jul 14 15:52:05.180074 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:52:05.180035    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be32d48_de2e_4891_bf85_5c26685dfc20.slice/crio-79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63 WatchSource:0}: Error finding container 79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63: Status 404 returned error can't find the container with id 79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63
Jul 14 15:52:05.182423 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:05.182404    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 15:52:05.278852 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:05.278823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf" event={"ID":"3be32d48-de2e-4891-bf85-5c26685dfc20","Type":"ContainerStarted","Data":"79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63"}
Jul 14 15:52:05.558254 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:05.558221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:13.313728 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:13.313695    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerID="24f396f310735ad1d87824c9f7e95f3b2a0c5ed34bd2726390d4cc2a0fc8fc76" exitCode=0
Jul 14 15:52:13.314113 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:13.313790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf" event={"ID":"3be32d48-de2e-4891-bf85-5c26685dfc20","Type":"ContainerDied","Data":"24f396f310735ad1d87824c9f7e95f3b2a0c5ed34bd2726390d4cc2a0fc8fc76"}
Jul 14 15:52:16.327806 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:16.327774    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerID="c781623d13ebf77c3cb17dbd64b24fb5eb82fa7d62aac68dcb4ea22d070841d0" exitCode=0
Jul 14 15:52:16.328227 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:16.327847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf" event={"ID":"3be32d48-de2e-4891-bf85-5c26685dfc20","Type":"ContainerDied","Data":"c781623d13ebf77c3cb17dbd64b24fb5eb82fa7d62aac68dcb4ea22d070841d0"}
Jul 14 15:52:23.358074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:23.357980    2564 generic.go:356] "Generic (PLEG): container finished" podID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerID="d8459aa46c46e3b1272fedfff0224b61779a80d91bb8215cca99864b7a698e1b" exitCode=0
Jul 14 15:52:23.358074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:23.358012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf" event={"ID":"3be32d48-de2e-4891-bf85-5c26685dfc20","Type":"ContainerDied","Data":"d8459aa46c46e3b1272fedfff0224b61779a80d91bb8215cca99864b7a698e1b"}
Jul 14 15:52:24.486120 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.486095    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:24.599866 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.599841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle\") pod \"3be32d48-de2e-4891-bf85-5c26685dfc20\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") "
Jul 14 15:52:24.599997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.599889    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util\") pod \"3be32d48-de2e-4891-bf85-5c26685dfc20\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") "
Jul 14 15:52:24.599997 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.599909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffk2w\" (UniqueName: \"kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w\") pod \"3be32d48-de2e-4891-bf85-5c26685dfc20\" (UID: \"3be32d48-de2e-4891-bf85-5c26685dfc20\") "
Jul 14 15:52:24.600536 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.600476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle" (OuterVolumeSpecName: "bundle") pod "3be32d48-de2e-4891-bf85-5c26685dfc20" (UID: "3be32d48-de2e-4891-bf85-5c26685dfc20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:52:24.602215 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.602182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w" (OuterVolumeSpecName: "kube-api-access-ffk2w") pod "3be32d48-de2e-4891-bf85-5c26685dfc20" (UID: "3be32d48-de2e-4891-bf85-5c26685dfc20"). InnerVolumeSpecName "kube-api-access-ffk2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:52:24.605013 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.604994    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util" (OuterVolumeSpecName: "util") pod "3be32d48-de2e-4891-bf85-5c26685dfc20" (UID: "3be32d48-de2e-4891-bf85-5c26685dfc20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:52:24.700785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.700760    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:24.700785 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.700785    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3be32d48-de2e-4891-bf85-5c26685dfc20-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:24.700932 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:24.700794    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffk2w\" (UniqueName: \"kubernetes.io/projected/3be32d48-de2e-4891-bf85-5c26685dfc20-kube-api-access-ffk2w\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:25.366744 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:25.366708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf" event={"ID":"3be32d48-de2e-4891-bf85-5c26685dfc20","Type":"ContainerDied","Data":"79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63"}
Jul 14 15:52:25.366744 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:25.366743    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540b5wnf"
Jul 14 15:52:25.366936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:25.366759    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79ef9aa59384c3cd460e5aa90cde4488855bf768c0d88a3d35cb275d9fef8f63"
Jul 14 15:52:30.933110 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:30.933021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:31.775439 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:31.775402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:32.897497 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897464    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"]
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897744    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="pull"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897754    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="pull"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897772    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="extract"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897777    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="extract"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897786    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="util"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897792    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="util"
Jul 14 15:52:32.897876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.897837    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be32d48-de2e-4891-bf85-5c26685dfc20" containerName="extract"
Jul 14 15:52:32.899783 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.899768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:32.902364 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.902343    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:52:32.902536 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.902514    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 14 15:52:32.902626 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.902527    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jhkrd\""
Jul 14 15:52:32.913350 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.913332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"]
Jul 14 15:52:32.963849 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.963821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef1548b-9bef-44dd-ba1b-d747d11812f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:32.963943 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:32.963878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52spw\" (UniqueName: \"kubernetes.io/projected/1ef1548b-9bef-44dd-ba1b-d747d11812f8-kube-api-access-52spw\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.064708 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.064685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52spw\" (UniqueName: \"kubernetes.io/projected/1ef1548b-9bef-44dd-ba1b-d747d11812f8-kube-api-access-52spw\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.064810 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.064733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef1548b-9bef-44dd-ba1b-d747d11812f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.065061 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.065045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef1548b-9bef-44dd-ba1b-d747d11812f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.073382 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.073359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52spw\" (UniqueName: \"kubernetes.io/projected/1ef1548b-9bef-44dd-ba1b-d747d11812f8-kube-api-access-52spw\") pod \"cert-manager-operator-controller-manager-55c444bf86-kddzs\" (UID: \"1ef1548b-9bef-44dd-ba1b-d747d11812f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.208845 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.208823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"
Jul 14 15:52:33.358812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.358688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs"]
Jul 14 15:52:33.361834 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:52:33.361808    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef1548b_9bef_44dd_ba1b_d747d11812f8.slice/crio-64c8199e6c6c59b29587f2c2133b424ef7d3a7f7de8fb7262925235e385ee1a7 WatchSource:0}: Error finding container 64c8199e6c6c59b29587f2c2133b424ef7d3a7f7de8fb7262925235e385ee1a7: Status 404 returned error can't find the container with id 64c8199e6c6c59b29587f2c2133b424ef7d3a7f7de8fb7262925235e385ee1a7
Jul 14 15:52:33.399326 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:33.399301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs" event={"ID":"1ef1548b-9bef-44dd-ba1b-d747d11812f8","Type":"ContainerStarted","Data":"64c8199e6c6c59b29587f2c2133b424ef7d3a7f7de8fb7262925235e385ee1a7"}
Jul 14 15:52:34.965690 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:34.965608    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:35.045240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:35.045195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:36.390734 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:36.390683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:36.413565 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:36.413535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs" event={"ID":"1ef1548b-9bef-44dd-ba1b-d747d11812f8","Type":"ContainerStarted","Data":"34545ad43fb14395d81c5decba957dc7160327bfc328fe0ed7405b43cbbb8018"}
Jul 14 15:52:36.435423 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:36.435365    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kddzs" podStartSLOduration=2.386044167 podStartE2EDuration="4.435348479s" totalImagesPullingTime="2.049304312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:52:36.433096429 +0000 UTC m=+362.178492955" watchObservedRunningTime="2026-07-14 15:52:36.435348479 +0000 UTC m=+362.180745005"
Jul 14 15:52:36.482992 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:36.482956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:37.164442 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.164407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:37.267413 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.267380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:37.374686 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.374654    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"]
Jul 14 15:52:37.378099 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.378083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.380554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.380528    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 15:52:37.381480 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.381464    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prqvp\""
Jul 14 15:52:37.381480 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.381471    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 15:52:37.387321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.387300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"]
Jul 14 15:52:37.499261 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.499174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.499261 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.499208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.499674 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.499322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc2pf\" (UniqueName: \"kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.600372 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.600337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.600372 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.600375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.600668 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.600426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc2pf\" (UniqueName: \"kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.600834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.600810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.600906 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.600820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.612469 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.612439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc2pf\" (UniqueName: \"kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.688241 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.688207    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:37.825111 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:37.825084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"]
Jul 14 15:52:37.827296 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:52:37.827271    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17664b8e_4aff_4397_8f49_b7bd26b7a08a.slice/crio-b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2 WatchSource:0}: Error finding container b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2: Status 404 returned error can't find the container with id b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2
Jul 14 15:52:38.390518 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:38.390484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:38.423241 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:38.423216    2564 generic.go:356] "Generic (PLEG): container finished" podID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerID="a79bbe973d5b769c1a530a1663aa97791fcb02a63848397da559f5cd50dac041" exitCode=0
Jul 14 15:52:38.423378 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:38.423261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2" event={"ID":"17664b8e-4aff-4397-8f49-b7bd26b7a08a","Type":"ContainerDied","Data":"a79bbe973d5b769c1a530a1663aa97791fcb02a63848397da559f5cd50dac041"}
Jul 14 15:52:38.423378 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:38.423296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2" event={"ID":"17664b8e-4aff-4397-8f49-b7bd26b7a08a","Type":"ContainerStarted","Data":"b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2"}
Jul 14 15:52:38.777285 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:38.777253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:39.022381 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.022344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srz78"]
Jul 14 15:52:39.025650 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.025631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.028066 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.028000    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 15:52:39.028066 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.028050    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 15:52:39.028066 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.028008    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gk94d\""
Jul 14 15:52:39.034616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.034580    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srz78"]
Jul 14 15:52:39.111752 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.111716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7s8\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-kube-api-access-ln7s8\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.111935 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.111756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.212828 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.212779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.213002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.212879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7s8\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-kube-api-access-ln7s8\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.221584 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.221548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.221853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.221831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7s8\" (UniqueName: \"kubernetes.io/projected/bbea2923-ae8d-4555-8c10-3792c13a161b-kube-api-access-ln7s8\") pod \"cert-manager-cainjector-559cdd8c87-srz78\" (UID: \"bbea2923-ae8d-4555-8c10-3792c13a161b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.334814 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.334722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78"
Jul 14 15:52:39.464653 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:39.464621    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-srz78"]
Jul 14 15:52:39.467741 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:52:39.467716    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbea2923_ae8d_4555_8c10_3792c13a161b.slice/crio-8015e988bb6c5f442083ce42ebd82ef97d0e0754d95a51798ef175a6f2e23342 WatchSource:0}: Error finding container 8015e988bb6c5f442083ce42ebd82ef97d0e0754d95a51798ef175a6f2e23342: Status 404 returned error can't find the container with id 8015e988bb6c5f442083ce42ebd82ef97d0e0754d95a51798ef175a6f2e23342
Jul 14 15:52:40.436584 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:40.436540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78" event={"ID":"bbea2923-ae8d-4555-8c10-3792c13a161b","Type":"ContainerStarted","Data":"8015e988bb6c5f442083ce42ebd82ef97d0e0754d95a51798ef175a6f2e23342"}
Jul 14 15:52:41.443355 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:41.443317    2564 generic.go:356] "Generic (PLEG): container finished" podID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerID="716cc49e09faf0b37743df8e1aa9bfbec709f59262d6f9ec4b6033b11c014a58" exitCode=0
Jul 14 15:52:41.443837 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:41.443392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2" event={"ID":"17664b8e-4aff-4397-8f49-b7bd26b7a08a","Type":"ContainerDied","Data":"716cc49e09faf0b37743df8e1aa9bfbec709f59262d6f9ec4b6033b11c014a58"}
Jul 14 15:52:41.724105 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:41.723944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:42.192702 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.192670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:42.449819 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.449779    2564 generic.go:356] "Generic (PLEG): container finished" podID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerID="9db49097278588a5465cf8e6c878d11c9104889aef50d4e37d93175bcd2cb73d" exitCode=0
Jul 14 15:52:42.450249 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.449866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2" event={"ID":"17664b8e-4aff-4397-8f49-b7bd26b7a08a","Type":"ContainerDied","Data":"9db49097278588a5465cf8e6c878d11c9104889aef50d4e37d93175bcd2cb73d"}
Jul 14 15:52:42.451511 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.451487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78" event={"ID":"bbea2923-ae8d-4555-8c10-3792c13a161b","Type":"ContainerStarted","Data":"01cb19ac7c7a8a74d9eb33d20d40e9a97fe939459e5565e1fe6d6f05d91e933d"}
Jul 14 15:52:42.485905 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.485850    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-srz78" podStartSLOduration=0.846973055 podStartE2EDuration="3.485835397s" totalImagesPullingTime="2.638862342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:52:42.485199214 +0000 UTC m=+368.230595743" watchObservedRunningTime="2026-07-14 15:52:42.485835397 +0000 UTC m=+368.231231924"
Jul 14 15:52:42.916462 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:42.916436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:43.017853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.017824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:43.583216 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.583192    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:43.654469 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.654438    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util\") pod \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") "
Jul 14 15:52:43.654709 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.654500    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc2pf\" (UniqueName: \"kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf\") pod \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") "
Jul 14 15:52:43.654709 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.654583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle\") pod \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\" (UID: \"17664b8e-4aff-4397-8f49-b7bd26b7a08a\") "
Jul 14 15:52:43.655011 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.654975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle" (OuterVolumeSpecName: "bundle") pod "17664b8e-4aff-4397-8f49-b7bd26b7a08a" (UID: "17664b8e-4aff-4397-8f49-b7bd26b7a08a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:52:43.656721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.656692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf" (OuterVolumeSpecName: "kube-api-access-kc2pf") pod "17664b8e-4aff-4397-8f49-b7bd26b7a08a" (UID: "17664b8e-4aff-4397-8f49-b7bd26b7a08a"). InnerVolumeSpecName "kube-api-access-kc2pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:52:43.659078 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.659056    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util" (OuterVolumeSpecName: "util") pod "17664b8e-4aff-4397-8f49-b7bd26b7a08a" (UID: "17664b8e-4aff-4397-8f49-b7bd26b7a08a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:52:43.755263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.755159    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:43.755263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.755205    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17664b8e-4aff-4397-8f49-b7bd26b7a08a-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:43.755263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:43.755219    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc2pf\" (UniqueName: \"kubernetes.io/projected/17664b8e-4aff-4397-8f49-b7bd26b7a08a-kube-api-access-kc2pf\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:52:44.461189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:44.461162    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2"
Jul 14 15:52:44.461355 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:44.461157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq4t2" event={"ID":"17664b8e-4aff-4397-8f49-b7bd26b7a08a","Type":"ContainerDied","Data":"b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2"}
Jul 14 15:52:44.461355 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:44.461284    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b841c2e8c029637ae1e9c50ebb65a7b2e80210c233f939f4f52657b0f05bece2"
Jul 14 15:52:47.240069 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:47.240031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:49.657107 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:49.657074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:49.751575 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:49.751531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:55.561165 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:55.561116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:55.665239 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:55.665196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:57.161199 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161167    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"]
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161461    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="util"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161472    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="util"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161490    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="pull"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161495    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="pull"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161502    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="extract"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161507    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="extract"
Jul 14 15:52:57.161561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.161558    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17664b8e-4aff-4397-8f49-b7bd26b7a08a" containerName="extract"
Jul 14 15:52:57.163524 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.163508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.166070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.166044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prqvp\""
Jul 14 15:52:57.166070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.166048    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 15:52:57.166228 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.166071    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 15:52:57.174115 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.174094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"]
Jul 14 15:52:57.261941 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.261898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.262132 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.261947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crkks\" (UniqueName: \"kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.262132 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.262042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.362622 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.362547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.362816 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.362656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.362816 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.362688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crkks\" (UniqueName: \"kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.362959 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.362936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.363013 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.362968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.371445 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.371411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crkks\" (UniqueName: \"kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.472544 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.472462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:52:57.475787 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.475742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:52:57.612402 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:57.612376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"]
Jul 14 15:52:57.614691 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:52:57.614664    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc1cbc2_8cda_4559_a7fe_1dc04a8d23f8.slice/crio-5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2 WatchSource:0}: Error finding container 5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2: Status 404 returned error can't find the container with id 5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2
Jul 14 15:52:58.523032 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:58.522996    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerID="840f28b4aa5b2c90b1aa0c8a7d7aebadcbb6767742f4c1426c3e0543c118ba2d" exitCode=0
Jul 14 15:52:58.523032 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:58.523034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb" event={"ID":"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8","Type":"ContainerDied","Data":"840f28b4aa5b2c90b1aa0c8a7d7aebadcbb6767742f4c1426c3e0543c118ba2d"}
Jul 14 15:52:58.523434 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:58.523074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb" event={"ID":"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8","Type":"ContainerStarted","Data":"5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2"}
Jul 14 15:52:59.529616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:59.529555    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerID="5fdb4be6c43f41b059c69a51b5391148645a5b42ee9b47bcc60040687b3b721a" exitCode=0
Jul 14 15:52:59.530004 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:52:59.529640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb" event={"ID":"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8","Type":"ContainerDied","Data":"5fdb4be6c43f41b059c69a51b5391148645a5b42ee9b47bcc60040687b3b721a"}
Jul 14 15:53:00.535950 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:00.535916    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerID="21089f12e0eba37d368c2612a43c24aabfea55b6351fd125e3e26b78a5cb8760" exitCode=0
Jul 14 15:53:00.536335 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:00.535981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb" event={"ID":"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8","Type":"ContainerDied","Data":"21089f12e0eba37d368c2612a43c24aabfea55b6351fd125e3e26b78a5cb8760"}
Jul 14 15:53:01.672331 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.672305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:53:01.801467 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.801380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crkks\" (UniqueName: \"kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks\") pod \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") "
Jul 14 15:53:01.801467 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.801424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle\") pod \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") "
Jul 14 15:53:01.801467 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.801467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util\") pod \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\" (UID: \"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8\") "
Jul 14 15:53:01.802213 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.802175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle" (OuterVolumeSpecName: "bundle") pod "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" (UID: "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:01.803751 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.803715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks" (OuterVolumeSpecName: "kube-api-access-crkks") pod "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" (UID: "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8"). InnerVolumeSpecName "kube-api-access-crkks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:53:01.807541 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.807523    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util" (OuterVolumeSpecName: "util") pod "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" (UID: "5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:01.902618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.902559    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crkks\" (UniqueName: \"kubernetes.io/projected/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-kube-api-access-crkks\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:01.902618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.902606    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:01.902618 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:01.902622    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:02.550999 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:02.550966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb" event={"ID":"5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8","Type":"ContainerDied","Data":"5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2"}
Jul 14 15:53:02.550999 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:02.551009    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5602bab3c230381cc91eac2d4b9dc1a0f04aec67c962950fb1eea967c9e84ba2"
Jul 14 15:53:02.551252 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:02.551012    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcj2qb"
Jul 14 15:53:03.728331 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.728276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:03.809843 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.809816    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-658b99d874-fc949"]
Jul 14 15:53:03.810089 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810078    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="pull"
Jul 14 15:53:03.810140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810091    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="pull"
Jul 14 15:53:03.810140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810101    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="extract"
Jul 14 15:53:03.810140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810108    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="extract"
Jul 14 15:53:03.810140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810118    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="util"
Jul 14 15:53:03.810140 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810124    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="util"
Jul 14 15:53:03.810317 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.810180    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc1cbc2-8cda-4559-a7fe-1dc04a8d23f8" containerName="extract"
Jul 14 15:53:03.812272 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.812256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.815033 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.815008    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 15:53:03.815033 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.815009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 15:53:03.815233 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.815120    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 15:53:03.816065 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.816046    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 15:53:03.816144 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.816051    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4cwj7\""
Jul 14 15:53:03.816144 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.816083    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 15:53:03.819981 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.819955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:03.821275 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.821258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zdf\" (UniqueName: \"kubernetes.io/projected/39156712-ec3f-445f-aa65-66d4dd014714-kube-api-access-z6zdf\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.821351 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.821301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39156712-ec3f-445f-aa65-66d4dd014714-manager-config\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.821351 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.821325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.821453 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.821350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-metrics-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.834405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.834372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-658b99d874-fc949"]
Jul 14 15:53:03.921995 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.921959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.922169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.922012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-metrics-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.922169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.922044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zdf\" (UniqueName: \"kubernetes.io/projected/39156712-ec3f-445f-aa65-66d4dd014714-kube-api-access-z6zdf\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.922169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.922097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39156712-ec3f-445f-aa65-66d4dd014714-manager-config\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.922845 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.922771    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39156712-ec3f-445f-aa65-66d4dd014714-manager-config\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.924633 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.924607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-metrics-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.924716 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.924637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39156712-ec3f-445f-aa65-66d4dd014714-cert\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:03.930104 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:03.930083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zdf\" (UniqueName: \"kubernetes.io/projected/39156712-ec3f-445f-aa65-66d4dd014714-kube-api-access-z6zdf\") pod \"lws-controller-manager-658b99d874-fc949\" (UID: \"39156712-ec3f-445f-aa65-66d4dd014714\") " pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:04.122215 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:04.122130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:04.259103 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:04.259069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-658b99d874-fc949"]
Jul 14 15:53:04.261803 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:53:04.261771    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39156712_ec3f_445f_aa65_66d4dd014714.slice/crio-03425d9ecd89316b08935ad0f8925095f8323c5bc0d7b88317c2dcdf57f0ed54 WatchSource:0}: Error finding container 03425d9ecd89316b08935ad0f8925095f8323c5bc0d7b88317c2dcdf57f0ed54: Status 404 returned error can't find the container with id 03425d9ecd89316b08935ad0f8925095f8323c5bc0d7b88317c2dcdf57f0ed54
Jul 14 15:53:04.561191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:04.561154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949" event={"ID":"39156712-ec3f-445f-aa65-66d4dd014714","Type":"ContainerStarted","Data":"03425d9ecd89316b08935ad0f8925095f8323c5bc0d7b88317c2dcdf57f0ed54"}
Jul 14 15:53:05.567188 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:05.567128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949" event={"ID":"39156712-ec3f-445f-aa65-66d4dd014714","Type":"ContainerStarted","Data":"fed2d8de2309e86257816238a57e596a2297dac2a51fbe2afc21382bd5f909ab"}
Jul 14 15:53:05.567552 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:05.567222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:05.588657 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:05.588613    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949" podStartSLOduration=1.39281884 podStartE2EDuration="2.588581532s" totalImagesPullingTime="1.195762692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:53:05.587107537 +0000 UTC m=+391.332504064" watchObservedRunningTime="2026-07-14 15:53:05.588581532 +0000 UTC m=+391.333978059"
Jul 14 15:53:13.361861 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:13.361827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:13.488173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:13.488128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:13.979038 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:13.979002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:14.227128 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.227085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:14.378794 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.378711    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"]
Jul 14 15:53:14.384342 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.384326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.389060 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.389037    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 15:53:14.389272 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.389256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-klszc\""
Jul 14 15:53:14.389977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.389958    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 15:53:14.390074 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.389987    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 15:53:14.395636 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.395607    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 15:53:14.403331 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.403304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-tmp\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.403486 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.403462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-manifests\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.403562 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.403501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.403562 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.403532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8hxz\" (UniqueName: \"kubernetes.io/projected/ff6d9858-a383-4f5d-aca5-87d80bd42278-kube-api-access-r8hxz\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.403705 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.403664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-webhook-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.405624 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.405579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"]
Jul 14 15:53:14.505033 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.504995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-manifests\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.505033 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.505034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.505260 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.505060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8hxz\" (UniqueName: \"kubernetes.io/projected/ff6d9858-a383-4f5d-aca5-87d80bd42278-kube-api-access-r8hxz\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.505260 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.505108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-webhook-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.505260 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.505158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-tmp\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.505509 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.505490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-manifests\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.507730 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.507703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9858-a383-4f5d-aca5-87d80bd42278-tmp\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.507848 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.507768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.507902 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.507874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff6d9858-a383-4f5d-aca5-87d80bd42278-webhook-cert\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.519060 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.519031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8hxz\" (UniqueName: \"kubernetes.io/projected/ff6d9858-a383-4f5d-aca5-87d80bd42278-kube-api-access-r8hxz\") pod \"opendatahub-operator-controller-manager-7486689d9d-k4rs7\" (UID: \"ff6d9858-a383-4f5d-aca5-87d80bd42278\") " pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.694698 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.694668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:14.773658 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.773623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:14.838565 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.838453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"]
Jul 14 15:53:14.843383 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:53:14.843358    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6d9858_a383_4f5d_aca5_87d80bd42278.slice/crio-8dfe7c0b583197d43450b655475053854a792ddafa0fb28fd7cd02b9aeb71e10 WatchSource:0}: Error finding container 8dfe7c0b583197d43450b655475053854a792ddafa0fb28fd7cd02b9aeb71e10: Status 404 returned error can't find the container with id 8dfe7c0b583197d43450b655475053854a792ddafa0fb28fd7cd02b9aeb71e10
Jul 14 15:53:14.850355 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.850330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:14.922646 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:14.922612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:15.027820 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:15.027710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:15.125332 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:15.125294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:15.612127 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:15.612086    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7" event={"ID":"ff6d9858-a383-4f5d-aca5-87d80bd42278","Type":"ContainerStarted","Data":"8dfe7c0b583197d43450b655475053854a792ddafa0fb28fd7cd02b9aeb71e10"}
Jul 14 15:53:16.030537 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:16.030500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:16.131010 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:16.130969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:16.574620 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:16.574378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-658b99d874-fc949"
Jul 14 15:53:18.629242 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:18.629208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7" event={"ID":"ff6d9858-a383-4f5d-aca5-87d80bd42278","Type":"ContainerStarted","Data":"53d05b1290f55618ed4939c794111a454e6d6f15ca3995e9dd22f361f752a403"}
Jul 14 15:53:20.639770 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:20.639739    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff6d9858-a383-4f5d-aca5-87d80bd42278" containerID="53d05b1290f55618ed4939c794111a454e6d6f15ca3995e9dd22f361f752a403" exitCode=0
Jul 14 15:53:20.640165 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:20.639822    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7" event={"ID":"ff6d9858-a383-4f5d-aca5-87d80bd42278","Type":"ContainerDied","Data":"53d05b1290f55618ed4939c794111a454e6d6f15ca3995e9dd22f361f752a403"}
Jul 14 15:53:21.646328 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:21.646236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7" event={"ID":"ff6d9858-a383-4f5d-aca5-87d80bd42278","Type":"ContainerStarted","Data":"bf050448e2fdb26476498d0cdc57ec3dd51a4176661ea84d7f378d87768a7d0f"}
Jul 14 15:53:21.646718 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:21.646461    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:21.668338 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:21.668262    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7" podStartSLOduration=2.205921942 podStartE2EDuration="7.668245315s" totalImagesPullingTime="4.41614541s" totalInitContainerRuntime="1.046177963s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:53:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:53:21.666912518 +0000 UTC m=+407.412309071" watchObservedRunningTime="2026-07-14 15:53:21.668245315 +0000 UTC m=+407.413641841"
Jul 14 15:53:28.946885 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:28.946847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:29.013200 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:29.013150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:29.380380 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:29.380297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:29.482045 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:29.481983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:32.653725 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:32.653697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7486689d9d-k4rs7"
Jul 14 15:53:34.248646 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:34.248576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:34.353220 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:34.353165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:34.560793 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:34.560698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:34.688853 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:34.688814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:35.010754 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:35.010715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:35.413101 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:35.413070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:35.535016 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:35.534982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:35.874765 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:35.874674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:35.966090 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:35.966051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:36.054532 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:36.054496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:36.148799 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:36.148703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:37.134307 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:37.134277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:41.995285 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:41.995221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:42.095633 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.095568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:42.261155 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.261080    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:42.267370 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.267353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.269927 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.269908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-87nqp\""
Jul 14 15:53:42.270041 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.269953    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 15:53:42.286375 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.286349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:42.314576 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.314545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:42.330572 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.330548    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"]
Jul 14 15:53:42.334409 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.334389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.336794 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.336769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.336908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.336804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.336908 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.336835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337021 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.336944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337021 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.336982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvbb\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337125 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.337027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337125 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.337058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337125 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.337091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.337125 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.337116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.356796 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.356761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"]
Jul 14 15:53:42.438191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438191 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvbb\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhw6\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-kube-api-access-2lhw6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.438745 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.438954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439087 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.439067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439403 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.439124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.439466 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.439445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.441079 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.441057    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.441382 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.441359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.453848 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.453817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvbb\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.455671 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.455649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.484800 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.484760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:42.539578 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539578 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539578 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539578 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.539917 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhw6\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-kube-api-access-2lhw6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.540162 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.539985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.540162 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.540022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.540291 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.540270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.540291 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.540283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.540559 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.540436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.542040 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.542015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.542267 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.542240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.549958 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.549936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.550169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.550148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhw6\" (UniqueName: \"kubernetes.io/projected/2d56cb23-ea4e-4ad7-8e75-d66d41955390-kube-api-access-2lhw6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wldcv\" (UID: \"2d56cb23-ea4e-4ad7-8e75-d66d41955390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.578214 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.578184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:42.600975 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.600951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:42.644828 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.644748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:42.722577 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.722551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:42.725271 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:53:42.725236    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ff777d_1eba_48a3_b154_3dff654fce74.slice/crio-a60130c5e9cc8a52fbfa2af2eae1c900796c64cc6e55c3bf1eb9170474031b36 WatchSource:0}: Error finding container a60130c5e9cc8a52fbfa2af2eae1c900796c64cc6e55c3bf1eb9170474031b36: Status 404 returned error can't find the container with id a60130c5e9cc8a52fbfa2af2eae1c900796c64cc6e55c3bf1eb9170474031b36
Jul 14 15:53:42.752879 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.752849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" event={"ID":"22ff777d-1eba-48a3-b154-3dff654fce74","Type":"ContainerStarted","Data":"a60130c5e9cc8a52fbfa2af2eae1c900796c64cc6e55c3bf1eb9170474031b36"}
Jul 14 15:53:42.807902 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:42.807871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"]
Jul 14 15:53:42.811082 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:53:42.811051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d56cb23_ea4e_4ad7_8e75_d66d41955390.slice/crio-3fb371b8dadbfee069a28f9fd610f51a6cb35251e7f77141abea569d0f57284c WatchSource:0}: Error finding container 3fb371b8dadbfee069a28f9fd610f51a6cb35251e7f77141abea569d0f57284c: Status 404 returned error can't find the container with id 3fb371b8dadbfee069a28f9fd610f51a6cb35251e7f77141abea569d0f57284c
Jul 14 15:53:43.761977 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:43.761890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv" event={"ID":"2d56cb23-ea4e-4ad7-8e75-d66d41955390","Type":"ContainerStarted","Data":"3fb371b8dadbfee069a28f9fd610f51a6cb35251e7f77141abea569d0f57284c"}
Jul 14 15:53:44.979887 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:44.979851    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"]
Jul 14 15:53:44.988506 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:44.988474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:44.992906 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:44.992882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 15:53:44.993134 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:44.993115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 15:53:44.993231 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:44.993140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bz77g\""
Jul 14 15:53:45.003104 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.003086    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 15:53:45.027258 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.027232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"]
Jul 14 15:53:45.064503 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064658 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064658 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064658 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hczkp\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-kube-api-access-hczkp\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064658 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064819 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/878bd690-d9ff-422b-a312-af34b271a6eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.064819 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.064717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.165930 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.165900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.165968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hczkp\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-kube-api-access-hczkp\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166407 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/878bd690-d9ff-422b-a312-af34b271a6eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.166807 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.166782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.169807 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.169774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/878bd690-d9ff-422b-a312-af34b271a6eb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.169900 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.169870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.169983 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.169960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.170078 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.170055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/878bd690-d9ff-422b-a312-af34b271a6eb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.178516 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.178493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hczkp\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-kube-api-access-hczkp\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.180150 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.180127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878bd690-d9ff-422b-a312-af34b271a6eb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q95rm\" (UID: \"878bd690-d9ff-422b-a312-af34b271a6eb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.302129 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.302043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:45.701621 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.701538    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.701742 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.701662    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.701742 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.701695    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.708195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.708171    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.708281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.708233    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.708281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.708262    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:45.786819 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:45.786775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"]
Jul 14 15:53:45.790258 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:53:45.790225    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878bd690_d9ff_422b_a312_af34b271a6eb.slice/crio-e63347323520185739dbabc018f11f5f3449991ce4a84652ce3de45c81a11b9b WatchSource:0}: Error finding container e63347323520185739dbabc018f11f5f3449991ce4a84652ce3de45c81a11b9b: Status 404 returned error can't find the container with id e63347323520185739dbabc018f11f5f3449991ce4a84652ce3de45c81a11b9b
Jul 14 15:53:46.782539 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:46.782497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" event={"ID":"22ff777d-1eba-48a3-b154-3dff654fce74","Type":"ContainerStarted","Data":"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"}
Jul 14 15:53:46.784021 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:46.783996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv" event={"ID":"2d56cb23-ea4e-4ad7-8e75-d66d41955390","Type":"ContainerStarted","Data":"c1cc864cc3822b795475af91638765c1204bb9f2d17b42e8eec4a4d5e196d7ff"}
Jul 14 15:53:46.785231 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:46.785211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm" event={"ID":"878bd690-d9ff-422b-a312-af34b271a6eb","Type":"ContainerStarted","Data":"e63347323520185739dbabc018f11f5f3449991ce4a84652ce3de45c81a11b9b"}
Jul 14 15:53:46.840808 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:46.840745    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" podStartSLOduration=1.867067402 podStartE2EDuration="4.840722601s" totalImagesPullingTime="2.973655199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:53:46.822870043 +0000 UTC m=+432.568266570" watchObservedRunningTime="2026-07-14 15:53:46.840722601 +0000 UTC m=+432.586119132"
Jul 14 15:53:46.879315 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:46.879263    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv" podStartSLOduration=1.984073554 podStartE2EDuration="4.879245652s" totalImagesPullingTime="2.895172098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:53:46.878113931 +0000 UTC m=+432.623510459" watchObservedRunningTime="2026-07-14 15:53:46.879245652 +0000 UTC m=+432.624642179"
Jul 14 15:53:47.341263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.341227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:47.441616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.441568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:47.508921 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.508873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:47.578587 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.578546    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:47.580396 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.580359    2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 15:53:47.580541 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.580420    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 15:53:47.645002 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.644912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:47.650522 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.650488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:47.664500 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.664472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:47.768306 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.768266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:47.790445 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.790413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:47.791419 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.791398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wldcv"
Jul 14 15:53:47.957667 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:47.957634    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:48.050694 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.050659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:48.149979 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.149923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:48.579405 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.579363    2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 15:53:48.579578 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.579448    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 15:53:48.705254 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.705216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:48.742481 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.742452    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:48.742556 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.742513    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 15:53:48.821300 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.821275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:48.896063 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:48.895962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:53:49.579530 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.579489    2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 15:53:49.579719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.579559    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 15:53:49.801987 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.801947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm" event={"ID":"878bd690-d9ff-422b-a312-af34b271a6eb","Type":"ContainerStarted","Data":"c3963c1395e3deed08a131ef9927a9ec82ec1e101ae1b33c3cf380b83ce0064d"}
Jul 14 15:53:49.802297 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.802275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:49.802432 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.802285    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy" containerID="cri-o://f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83" gracePeriod=30
Jul 14 15:53:49.804177 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.804156    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm"
Jul 14 15:53:49.834922 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:49.834831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q95rm" podStartSLOduration=2.88541233 podStartE2EDuration="5.834815882s" totalImagesPullingTime="2.949403552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:53:49.833462255 +0000 UTC m=+435.578858780" watchObservedRunningTime="2026-07-14 15:53:49.834815882 +0000 UTC m=+435.580212406"
Jul 14 15:53:55.059772 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.059747    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:55.156240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156156    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156192    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156240 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156228    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqvbb\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156253    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156277    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.156476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.156470    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket\") pod \"22ff777d-1eba-48a3-b154-3dff654fce74\" (UID: \"22ff777d-1eba-48a3-b154-3dff654fce74\") "
Jul 14 15:53:55.158845 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.158811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data" (OuterVolumeSpecName: "istio-data") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:55.158976 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.158958    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:55.159068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.159045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:55.159126 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.159078    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:53:55.159196 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.159171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:55.161041 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.161012    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token" (OuterVolumeSpecName: "istio-token") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:53:55.161124 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.161094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb" (OuterVolumeSpecName: "kube-api-access-wqvbb") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "kube-api-access-wqvbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:53:55.161235 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.161215    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 15:53:55.161235 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.161225    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22ff777d-1eba-48a3-b154-3dff654fce74" (UID: "22ff777d-1eba-48a3-b154-3dff654fce74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:53:55.257883 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257847    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.257883 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257874    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.257883 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257883    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.257883 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257894    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.258142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257903    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.258142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257912    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ff777d-1eba-48a3-b154-3dff654fce74-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.258142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257920    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqvbb\" (UniqueName: \"kubernetes.io/projected/22ff777d-1eba-48a3-b154-3dff654fce74-kube-api-access-wqvbb\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.258142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257928    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ff777d-1eba-48a3-b154-3dff654fce74-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.258142 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.257937    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ff777d-1eba-48a3-b154-3dff654fce74-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:53:55.831962 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.831877    2564 generic.go:356] "Generic (PLEG): container finished" podID="22ff777d-1eba-48a3-b154-3dff654fce74" containerID="f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83" exitCode=0
Jul 14 15:53:55.831962 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.831940    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"
Jul 14 15:53:55.832169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.831961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" event={"ID":"22ff777d-1eba-48a3-b154-3dff654fce74","Type":"ContainerDied","Data":"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"}
Jul 14 15:53:55.832169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.832019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl" event={"ID":"22ff777d-1eba-48a3-b154-3dff654fce74","Type":"ContainerDied","Data":"a60130c5e9cc8a52fbfa2af2eae1c900796c64cc6e55c3bf1eb9170474031b36"}
Jul 14 15:53:55.832169 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.832043    2564 scope.go:117] "RemoveContainer" containerID="f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"
Jul 14 15:53:55.841238 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.841220    2564 scope.go:117] "RemoveContainer" containerID="f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"
Jul 14 15:53:55.841527 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:53:55.841507    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83\": container with ID starting with f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83 not found: ID does not exist" containerID="f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"
Jul 14 15:53:55.841647 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.841533    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83"} err="failed to get container status \"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83\": rpc error: code = NotFound desc = could not find container \"f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83\": container with ID starting with f6b7ec481d81fd669ec57b060de9f3f1d15fdc0c8290ac9aa79e6b624f305b83 not found: ID does not exist"
Jul 14 15:53:55.851726 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:53:55.851707    2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ff777d_1eba_48a3_b154_3dff654fce74.slice\": RecentStats: unable to find data in memory cache]"
Jul 14 15:53:55.857295 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.857273    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:55.861212 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:55.861190    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-mdtsl"]
Jul 14 15:53:56.770028 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:53:56.769993    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" path="/var/lib/kubelet/pods/22ff777d-1eba-48a3-b154-3dff654fce74/volumes"
Jul 14 15:54:19.561251 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:19.561216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:35.765545 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:35.765513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:35.866492 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:35.866449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:36.005448 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:36.005407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:36.734030 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:36.734001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:36.935006 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:36.934974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:44.004125 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:44.004081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:44.133393 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:44.133358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:44.237214 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:44.237161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:44.730709 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:44.730644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:51.712159 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.712120    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"]
Jul 14 15:54:51.712652 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.712438    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy"
Jul 14 15:54:51.712652 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.712449    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy"
Jul 14 15:54:51.712652 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.712518    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ff777d-1eba-48a3-b154-3dff654fce74" containerName="istio-proxy"
Jul 14 15:54:51.715347 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.715331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.717835 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.717813    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 15:54:51.718765 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.718750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wt668\""
Jul 14 15:54:51.718848 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.718776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 15:54:51.724664 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.724642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"]
Jul 14 15:54:51.742924 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.742895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.743027 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.742953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.743027 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.742988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9krsr\" (UniqueName: \"kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.844319 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.844281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9krsr\" (UniqueName: \"kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.844491 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.844333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.844491 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.844383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.844769 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.844752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.844812 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.844781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:51.853289 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:51.853262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9krsr\" (UniqueName: \"kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:52.025099 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.025006    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:52.119904 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.119861    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"]
Jul 14 15:54:52.122651 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.122629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.133616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.133573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"]
Jul 14 15:54:52.147512 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.147482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnwk6\" (UniqueName: \"kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.147701 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.147525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.147701 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.147635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.163298 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.163275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"]
Jul 14 15:54:52.166045 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:54:52.166020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba60fe5c_6d6f_46dd_b5e0_8979a4fda276.slice/crio-1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17 WatchSource:0}: Error finding container 1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17: Status 404 returned error can't find the container with id 1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17
Jul 14 15:54:52.248506 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.248474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.248670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.248560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnwk6\" (UniqueName: \"kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.248670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.248585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.248887 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.248867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.248938 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.248886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.257319 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.257281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnwk6\" (UniqueName: \"kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.435263 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.435230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:52.515852 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.515823    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"]
Jul 14 15:54:52.519162 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.519132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.530580 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.530532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"]
Jul 14 15:54:52.551563 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.551520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7tx\" (UniqueName: \"kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.551768 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.551573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.551768 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.551636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.572985 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.572896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"]
Jul 14 15:54:52.575108 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:54:52.575082    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cd1b0c_0d91_4209_a3ce_ee7970678af4.slice/crio-4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29 WatchSource:0}: Error finding container 4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29: Status 404 returned error can't find the container with id 4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29
Jul 14 15:54:52.652432 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.652398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7tx\" (UniqueName: \"kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.652574 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.652443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.652574 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.652479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.652965 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.652947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.653000 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.652948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.660539 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.660517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7tx\" (UniqueName: \"kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.831022 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.830936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:52.963111 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:52.963087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"]
Jul 14 15:54:52.964967 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:54:52.964935    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e9f43c_5cd7_4c20_ba8f_0df9866d0d17.slice/crio-fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29 WatchSource:0}: Error finding container fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29: Status 404 returned error can't find the container with id fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29
Jul 14 15:54:53.101543 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.101469    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerID="acd19693f87bca0e92cbe0d1b14026f0b2f9ec09aa4b0ffb7cbbbf5be53497dd" exitCode=0
Jul 14 15:54:53.101543 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.101506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj" event={"ID":"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276","Type":"ContainerDied","Data":"acd19693f87bca0e92cbe0d1b14026f0b2f9ec09aa4b0ffb7cbbbf5be53497dd"}
Jul 14 15:54:53.101742 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.101569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj" event={"ID":"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276","Type":"ContainerStarted","Data":"1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17"}
Jul 14 15:54:53.103172 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.103149    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerID="cea50c2a527f22592033794010567da867c60e4808b4157a57c931b03b979482" exitCode=0
Jul 14 15:54:53.103283 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.103231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh" event={"ID":"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17","Type":"ContainerDied","Data":"cea50c2a527f22592033794010567da867c60e4808b4157a57c931b03b979482"}
Jul 14 15:54:53.103283 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.103266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh" event={"ID":"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17","Type":"ContainerStarted","Data":"fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29"}
Jul 14 15:54:53.105034 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.105008    2564 generic.go:356] "Generic (PLEG): container finished" podID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerID="06ae257bccc70c246b277bdf5f9d1c925bedf5594e41faa8f3a5cd368297a66f" exitCode=0
Jul 14 15:54:53.105143 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.105077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw" event={"ID":"32cd1b0c-0d91-4209-a3ce-ee7970678af4","Type":"ContainerDied","Data":"06ae257bccc70c246b277bdf5f9d1c925bedf5594e41faa8f3a5cd368297a66f"}
Jul 14 15:54:53.105143 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.105111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw" event={"ID":"32cd1b0c-0d91-4209-a3ce-ee7970678af4","Type":"ContainerStarted","Data":"4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29"}
Jul 14 15:54:53.114224 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.114201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"]
Jul 14 15:54:53.117116 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.117100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.126116 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.126093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"]
Jul 14 15:54:53.156208 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.156177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.156208 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.156207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.156419 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.156291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75mdz\" (UniqueName: \"kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.256940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.256908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.256940 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.256945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.257178 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.256991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75mdz\" (UniqueName: \"kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.257319 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.257301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.257367 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.257329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.266445 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.266417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75mdz\" (UniqueName: \"kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.431663 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.431630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:53.569429 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:53.569404    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"]
Jul 14 15:54:53.571473 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:54:53.571445    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500c4759_d8e0_4b6a_9fd4_8f38c83f3054.slice/crio-d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525 WatchSource:0}: Error finding container d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525: Status 404 returned error can't find the container with id d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525
Jul 14 15:54:54.112583 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.112547    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerID="20d24841a9d3c16c057b4e13f3db645f1d35962533893f4344b60637d861413f" exitCode=0
Jul 14 15:54:54.112945 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.112633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh" event={"ID":"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17","Type":"ContainerDied","Data":"20d24841a9d3c16c057b4e13f3db645f1d35962533893f4344b60637d861413f"}
Jul 14 15:54:54.114567 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.114544    2564 generic.go:356] "Generic (PLEG): container finished" podID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerID="623c061aee1a67cb51e5ff0d703106eda363daf5f846cde5775a7d81664416a8" exitCode=0
Jul 14 15:54:54.114701 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.114620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw" event={"ID":"32cd1b0c-0d91-4209-a3ce-ee7970678af4","Type":"ContainerDied","Data":"623c061aee1a67cb51e5ff0d703106eda363daf5f846cde5775a7d81664416a8"}
Jul 14 15:54:54.116283 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.116259    2564 generic.go:356] "Generic (PLEG): container finished" podID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerID="eafcd248f075fe2fb25474a17ece786c666a2c0c6d8ba29d3b7012bf929aa776" exitCode=0
Jul 14 15:54:54.116380 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.116306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr" event={"ID":"500c4759-d8e0-4b6a-9fd4-8f38c83f3054","Type":"ContainerDied","Data":"eafcd248f075fe2fb25474a17ece786c666a2c0c6d8ba29d3b7012bf929aa776"}
Jul 14 15:54:54.116380 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.116339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr" event={"ID":"500c4759-d8e0-4b6a-9fd4-8f38c83f3054","Type":"ContainerStarted","Data":"d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525"}
Jul 14 15:54:54.407817 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.407743    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:54:54.569561 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.569526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:54.699535 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.699504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:54.868143 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:54.868109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:55.123947 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.123915    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerID="bf1a440acb85582b43b223be71dbd9e2455e31f97c770068df219d97afbfb9cd" exitCode=0
Jul 14 15:54:55.124353 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.124005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh" event={"ID":"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17","Type":"ContainerDied","Data":"bf1a440acb85582b43b223be71dbd9e2455e31f97c770068df219d97afbfb9cd"}
Jul 14 15:54:55.125970 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.125951    2564 generic.go:356] "Generic (PLEG): container finished" podID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerID="e254b8f1764e679e9a7f0dcb1c048f1b3e4492caa4eae2318149953ffda078ad" exitCode=0
Jul 14 15:54:55.126056 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.126034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw" event={"ID":"32cd1b0c-0d91-4209-a3ce-ee7970678af4","Type":"ContainerDied","Data":"e254b8f1764e679e9a7f0dcb1c048f1b3e4492caa4eae2318149953ffda078ad"}
Jul 14 15:54:55.127728 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.127706    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerID="ade998a541359627b005d94d73739c2a40a697a8ab6386e86b0f9d89eed5f641" exitCode=0
Jul 14 15:54:55.127808 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.127784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj" event={"ID":"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276","Type":"ContainerDied","Data":"ade998a541359627b005d94d73739c2a40a697a8ab6386e86b0f9d89eed5f641"}
Jul 14 15:54:55.129683 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.129661    2564 generic.go:356] "Generic (PLEG): container finished" podID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerID="f2862ba904b1e3285f3200dd0c7fa7cce5b5dea6b043fd8727a64d044bca34e9" exitCode=0
Jul 14 15:54:55.129776 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:55.129712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr" event={"ID":"500c4759-d8e0-4b6a-9fd4-8f38c83f3054","Type":"ContainerDied","Data":"f2862ba904b1e3285f3200dd0c7fa7cce5b5dea6b043fd8727a64d044bca34e9"}
Jul 14 15:54:56.003471 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.003420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:56.103316 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.103282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:56.137152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.137077    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerID="1e35422850f8e8189a491843c24cb5f02e2dcbe4ccc43a370a96e6d8584edcd5" exitCode=0
Jul 14 15:54:56.137152 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.137125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj" event={"ID":"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276","Type":"ContainerDied","Data":"1e35422850f8e8189a491843c24cb5f02e2dcbe4ccc43a370a96e6d8584edcd5"}
Jul 14 15:54:56.139354 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.139324    2564 generic.go:356] "Generic (PLEG): container finished" podID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerID="72e433a05b9295936788c14606a3fe5cae02e8fced9d0938bc602b3c67e305bf" exitCode=0
Jul 14 15:54:56.139475 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.139396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr" event={"ID":"500c4759-d8e0-4b6a-9fd4-8f38c83f3054","Type":"ContainerDied","Data":"72e433a05b9295936788c14606a3fe5cae02e8fced9d0938bc602b3c67e305bf"}
Jul 14 15:54:56.279459 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.279438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:56.295764 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.295744    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:56.386613 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386558    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnwk6\" (UniqueName: \"kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6\") pod \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") "
Jul 14 15:54:56.386613 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386610    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k7tx\" (UniqueName: \"kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx\") pod \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") "
Jul 14 15:54:56.386805 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386664    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle\") pod \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") "
Jul 14 15:54:56.386805 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util\") pod \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") "
Jul 14 15:54:56.386805 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386760    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle\") pod \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\" (UID: \"32cd1b0c-0d91-4209-a3ce-ee7970678af4\") "
Jul 14 15:54:56.386805 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.386782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util\") pod \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\" (UID: \"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17\") "
Jul 14 15:54:56.387497 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.387316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle" (OuterVolumeSpecName: "bundle") pod "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" (UID: "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:56.387641 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.387492    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle" (OuterVolumeSpecName: "bundle") pod "32cd1b0c-0d91-4209-a3ce-ee7970678af4" (UID: "32cd1b0c-0d91-4209-a3ce-ee7970678af4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:56.389107 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.389086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx" (OuterVolumeSpecName: "kube-api-access-6k7tx") pod "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" (UID: "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17"). InnerVolumeSpecName "kube-api-access-6k7tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:54:56.389216 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.389200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6" (OuterVolumeSpecName: "kube-api-access-wnwk6") pod "32cd1b0c-0d91-4209-a3ce-ee7970678af4" (UID: "32cd1b0c-0d91-4209-a3ce-ee7970678af4"). InnerVolumeSpecName "kube-api-access-wnwk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:54:56.392049 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.392024    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util" (OuterVolumeSpecName: "util") pod "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" (UID: "a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:56.392899 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.392877    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util" (OuterVolumeSpecName: "util") pod "32cd1b0c-0d91-4209-a3ce-ee7970678af4" (UID: "32cd1b0c-0d91-4209-a3ce-ee7970678af4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:56.487836 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487802    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:56.487836 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487830    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32cd1b0c-0d91-4209-a3ce-ee7970678af4-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:56.487836 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487839    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:56.488043 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487851    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnwk6\" (UniqueName: \"kubernetes.io/projected/32cd1b0c-0d91-4209-a3ce-ee7970678af4-kube-api-access-wnwk6\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:56.488043 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487862    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k7tx\" (UniqueName: \"kubernetes.io/projected/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-kube-api-access-6k7tx\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:56.488043 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:56.487871    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.145961 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.145868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh" event={"ID":"a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17","Type":"ContainerDied","Data":"fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29"}
Jul 14 15:54:57.145961 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.145885    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh"
Jul 14 15:54:57.145961 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.145917    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa618a1b97b1616604eaac187ca901839745855018aa2712bc8655892908da29"
Jul 14 15:54:57.148096 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.148018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw" event={"ID":"32cd1b0c-0d91-4209-a3ce-ee7970678af4","Type":"ContainerDied","Data":"4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29"}
Jul 14 15:54:57.148096 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.148076    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4784b565976638f2912df533f79b6c5c4b0a4f95a60ee8634afac3616d1aaf29"
Jul 14 15:54:57.148096 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.148005    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw"
Jul 14 15:54:57.305409 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.305383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:57.308579 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.308558    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:57.395281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395249    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util\") pod \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") "
Jul 14 15:54:57.395281 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395288    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util\") pod \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") "
Jul 14 15:54:57.395515 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395312    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75mdz\" (UniqueName: \"kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz\") pod \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") "
Jul 14 15:54:57.395515 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395345    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle\") pod \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") "
Jul 14 15:54:57.395515 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle\") pod \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\" (UID: \"500c4759-d8e0-4b6a-9fd4-8f38c83f3054\") "
Jul 14 15:54:57.395515 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9krsr\" (UniqueName: \"kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr\") pod \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\" (UID: \"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276\") "
Jul 14 15:54:57.395955 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle" (OuterVolumeSpecName: "bundle") pod "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" (UID: "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:57.396100 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.395925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle" (OuterVolumeSpecName: "bundle") pod "500c4759-d8e0-4b6a-9fd4-8f38c83f3054" (UID: "500c4759-d8e0-4b6a-9fd4-8f38c83f3054"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:57.397793 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.397771    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz" (OuterVolumeSpecName: "kube-api-access-75mdz") pod "500c4759-d8e0-4b6a-9fd4-8f38c83f3054" (UID: "500c4759-d8e0-4b6a-9fd4-8f38c83f3054"). InnerVolumeSpecName "kube-api-access-75mdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:54:57.398039 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.398023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr" (OuterVolumeSpecName: "kube-api-access-9krsr") pod "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" (UID: "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276"). InnerVolumeSpecName "kube-api-access-9krsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:54:57.401499 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.401464    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util" (OuterVolumeSpecName: "util") pod "500c4759-d8e0-4b6a-9fd4-8f38c83f3054" (UID: "500c4759-d8e0-4b6a-9fd4-8f38c83f3054"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:57.402193 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.402173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util" (OuterVolumeSpecName: "util") pod "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" (UID: "ba60fe5c-6d6f-46dd-b5e0-8979a4fda276"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 15:54:57.496936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496899    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.496936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496928    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.496936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496937    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9krsr\" (UniqueName: \"kubernetes.io/projected/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-kube-api-access-9krsr\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.496936 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496947    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba60fe5c-6d6f-46dd-b5e0-8979a4fda276-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.497195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496958    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.497195 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.496966    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75mdz\" (UniqueName: \"kubernetes.io/projected/500c4759-d8e0-4b6a-9fd4-8f38c83f3054-kube-api-access-75mdz\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:54:57.956828 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:57.956795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:54:58.157893 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.157865    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr"
Jul 14 15:54:58.157893 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.157873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr" event={"ID":"500c4759-d8e0-4b6a-9fd4-8f38c83f3054","Type":"ContainerDied","Data":"d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525"}
Jul 14 15:54:58.158355 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.157924    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d12b37e553d886828c16d6135081b35c7a13b9260ef8ec753c7e11ab596a3525"
Jul 14 15:54:58.159989 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.159953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj" event={"ID":"ba60fe5c-6d6f-46dd-b5e0-8979a4fda276","Type":"ContainerDied","Data":"1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17"}
Jul 14 15:54:58.159989 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.159974    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj"
Jul 14 15:54:58.160138 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:58.159998    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fffa99a907c5e63844c3e92ba91d66ec0e93d326cdc5dfcee398163e6cecc17"
Jul 14 15:54:59.898068 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:54:59.898034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:02.862218 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:02.862175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:04.783173 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:04.783142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:05.199007 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:05.198970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:05.837806 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:05.837768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:07.797939 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:07.797895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:08.460798 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:08.460760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:09.999189 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:09.999147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:10.633551 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:10.633521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:13.526762 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:13.526728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:13.679097 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:13.679054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:14.205551 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:14.205514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:14.449721 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:14.449676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:17.857695 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:17.857652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:17.960408 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:17.960372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:19.429836 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.429790    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d6b67cf57-w7rvq" podUID="1dc9bccc-1242-4721-9def-828389467b4e" containerName="console" containerID="cri-o://6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8" gracePeriod=15
Jul 14 15:55:19.679266 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.679236    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:55:19.795086 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.794992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795086 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795041    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795086 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795368 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqtqv\" (UniqueName: \"kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv\") pod \"1dc9bccc-1242-4721-9def-828389467b4e\" (UID: \"1dc9bccc-1242-4721-9def-828389467b4e\") "
Jul 14 15:55:19.795616 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795561    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:55:19.795690 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config" (OuterVolumeSpecName: "console-config") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:55:19.795690 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:55:19.795934 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.795907    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 15:55:19.797265 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.797238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:55:19.797389 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.797329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 15:55:19.797456 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.797433    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv" (OuterVolumeSpecName: "kube-api-access-fqtqv") pod "1dc9bccc-1242-4721-9def-828389467b4e" (UID: "1dc9bccc-1242-4721-9def-828389467b4e"). InnerVolumeSpecName "kube-api-access-fqtqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 15:55:19.896321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896286    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896313    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896322    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc9bccc-1242-4721-9def-828389467b4e-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896331    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896321 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896340    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896348    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dc9bccc-1242-4721-9def-828389467b4e-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:19.896719 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:19.896356    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqtqv\" (UniqueName: \"kubernetes.io/projected/1dc9bccc-1242-4721-9def-828389467b4e-kube-api-access-fqtqv\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 15:55:20.274659 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.274623    2564 generic.go:356] "Generic (PLEG): container finished" podID="1dc9bccc-1242-4721-9def-828389467b4e" containerID="6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8" exitCode=0
Jul 14 15:55:20.274834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.274690    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b67cf57-w7rvq"
Jul 14 15:55:20.274834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.274712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b67cf57-w7rvq" event={"ID":"1dc9bccc-1242-4721-9def-828389467b4e","Type":"ContainerDied","Data":"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"}
Jul 14 15:55:20.274834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.274771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b67cf57-w7rvq" event={"ID":"1dc9bccc-1242-4721-9def-828389467b4e","Type":"ContainerDied","Data":"c05c059db7a09e6ef11531cc7a10cafbd52e5ae1e052069a2e446ef3c00b3610"}
Jul 14 15:55:20.274834 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.274797    2564 scope.go:117] "RemoveContainer" containerID="6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"
Jul 14 15:55:20.284272 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.284254    2564 scope.go:117] "RemoveContainer" containerID="6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"
Jul 14 15:55:20.284531 ip-10-0-129-145 kubenswrapper[2564]: E0714 15:55:20.284511    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8\": container with ID starting with 6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8 not found: ID does not exist" containerID="6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"
Jul 14 15:55:20.284575 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.284541    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8"} err="failed to get container status \"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8\": rpc error: code = NotFound desc = could not find container \"6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8\": container with ID starting with 6a3906d2690416594cc128cbd60ccd035142ce97315f66e7b7bfc50001f6f9c8 not found: ID does not exist"
Jul 14 15:55:20.295642 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.295620    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:55:20.299160 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.299138    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d6b67cf57-w7rvq"]
Jul 14 15:55:20.768824 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:20.768790    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc9bccc-1242-4721-9def-828389467b4e" path="/var/lib/kubelet/pods/1dc9bccc-1242-4721-9def-828389467b4e/volumes"
Jul 14 15:55:22.757507 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:22.757468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:23.619190 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:23.619147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:23.719326 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:23.719295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:26.639003 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:26.638903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:26.805404 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:26.805368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:29.073935 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:29.073884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:29.176512 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:29.176480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:34.805502 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:34.805469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:34.905887 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:34.905854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:43.117260 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:43.117222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:43.208011 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:43.207969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:45.007476 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:45.007443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:45.107915 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:45.107864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:45.210385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:45.210348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:45.310966 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:45.310862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:47.017342 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:47.017307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:47.124660 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:47.124587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:48.815815 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:48.815780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:49.495008 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:49.494970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:49.598079 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:49.598050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:54.755876 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:54.755821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:55.372088 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:55.372043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:59.603535 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:59.603504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:55:59.703534 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:55:59.703503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:00.537729 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.537693    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:56:00.538016 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538004    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="pull"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538017    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="pull"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538025    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="util"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538031    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="util"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538038    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="extract"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538044    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="extract"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538052    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="util"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538058    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="util"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538063    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="pull"
Jul 14 15:56:00.538070 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538069    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="pull"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538076    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="pull"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538081    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="pull"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538089    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="util"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538094    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="util"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="util"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538105    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="util"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538110    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538115    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538123    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="pull"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538127    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="pull"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538133    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc9bccc-1242-4721-9def-828389467b4e" containerName="console"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538137    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc9bccc-1242-4721-9def-828389467b4e" containerName="console"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538148    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538159    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538163    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538212    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc9bccc-1242-4721-9def-828389467b4e" containerName="console"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538220    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538225    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba60fe5c-6d6f-46dd-b5e0-8979a4fda276" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538229    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="500c4759-d8e0-4b6a-9fd4-8f38c83f3054" containerName="extract"
Jul 14 15:56:00.538385 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.538235    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="32cd1b0c-0d91-4209-a3ce-ee7970678af4" containerName="extract"
Jul 14 15:56:00.540714 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.540695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.543092 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.543067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 15:56:00.543237 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.543154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 15:56:00.543237 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.543160    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 15:56:00.543920 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.543901    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wt668\""
Jul 14 15:56:00.552795 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.552776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:56:00.567234 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.567205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:56:00.601347 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.601324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pt7z\" (UniqueName: \"kubernetes.io/projected/20bc031a-4d23-450c-8aa4-e1e3b193a10f-kube-api-access-5pt7z\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.601456 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.601364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20bc031a-4d23-450c-8aa4-e1e3b193a10f-config-file\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.702153 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.702124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pt7z\" (UniqueName: \"kubernetes.io/projected/20bc031a-4d23-450c-8aa4-e1e3b193a10f-kube-api-access-5pt7z\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.702557 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.702167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20bc031a-4d23-450c-8aa4-e1e3b193a10f-config-file\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.702792 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.702775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20bc031a-4d23-450c-8aa4-e1e3b193a10f-config-file\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.711459 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.711436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pt7z\" (UniqueName: \"kubernetes.io/projected/20bc031a-4d23-450c-8aa4-e1e3b193a10f-kube-api-access-5pt7z\") pod \"limitador-limitador-54d6d988d5-crvht\" (UID: \"20bc031a-4d23-450c-8aa4-e1e3b193a10f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.851137 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.851059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:00.977670 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.977625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:00.986437 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:00.986416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:56:00.988412 ip-10-0-129-145 kubenswrapper[2564]: W0714 15:56:00.988372    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bc031a_4d23_450c_8aa4_e1e3b193a10f.slice/crio-ce23ac5af3c891496408f18a8429cc8ff4c28ce14f8f2947f5afefff536b8bad WatchSource:0}: Error finding container ce23ac5af3c891496408f18a8429cc8ff4c28ce14f8f2947f5afefff536b8bad: Status 404 returned error can't find the container with id ce23ac5af3c891496408f18a8429cc8ff4c28ce14f8f2947f5afefff536b8bad
Jul 14 15:56:01.077664 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:01.077628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:01.488736 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:01.488702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht" event={"ID":"20bc031a-4d23-450c-8aa4-e1e3b193a10f","Type":"ContainerStarted","Data":"ce23ac5af3c891496408f18a8429cc8ff4c28ce14f8f2947f5afefff536b8bad"}
Jul 14 15:56:04.507105 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:04.507074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht" event={"ID":"20bc031a-4d23-450c-8aa4-e1e3b193a10f","Type":"ContainerStarted","Data":"24a1c3c1d5cd06b928347b56d9002e1c4c1cfca163d6bc8704c0494e588c1634"}
Jul 14 15:56:04.507480 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:04.507193    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:04.527347 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:04.527278    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht" podStartSLOduration=1.9225103080000001 podStartE2EDuration="4.527259767s" totalImagesPullingTime="2.604749459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:56:04.526986202 +0000 UTC m=+570.272382723" watchObservedRunningTime="2026-07-14 15:56:04.527259767 +0000 UTC m=+570.272656294"
Jul 14 15:56:15.514299 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:15.514264    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-crvht"
Jul 14 15:56:20.815275 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:20.815239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:20.908252 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:20.908215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:21.314884 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:21.314844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:33.963984 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:33.963950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:34.051691 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:34.051652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:34.658397 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:34.658366    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:56:34.660902 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:34.660875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 15:56:40.419996 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:40.419959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:40.517863 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:40.517827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:40.632875 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:40.632845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:43.538511 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:43.538472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:43.640959 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:43.640924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:56:55.010740 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:56:55.010702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:16.163008 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:16.162957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:17.570197 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:17.570167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:57:18.652907 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:18.652870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:27.947317 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:27.947267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:28.115311 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:28.115276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:45.626617 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:45.626560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:57:46.209968 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:57:46.209929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:00.611849 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:00.611810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:08.337706 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:08.337666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:09.290585 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:09.290549    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:17.107164 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:17.107114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:18.587644 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:18.587587    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:22.215967 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:22.215895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:24.389512 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:24.389465    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:28.031562 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:28.031482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:30.194843 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:30.194798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:43.532161 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:43.532119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:58:46.200763 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:46.200718    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 15:58:55.864229 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:58:55.864189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:18.224874 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:18.224834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:18.325552 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:18.325519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:49.230554 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:49.230508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:49.329265 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:49.329211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:50.495217 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:50.495179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 15:59:51.180426 ip-10-0-129-145 kubenswrapper[2564]: I0714 15:59:51.180394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:00:00.152524 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.152432    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"]
Jul 14 16:00:00.155914 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.155888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"
Jul 14 16:00:00.158580 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.158560    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-62c9m\""
Jul 14 16:00:00.164796 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.164764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"]
Jul 14 16:00:00.167809 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.167786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"
Jul 14 16:00:00.303401 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.303368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"]
Jul 14 16:00:00.304918 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:00:00.304891    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c349ab_4758_4dde_b514_4b1a39f51087.slice/crio-78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119 WatchSource:0}: Error finding container 78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119: Status 404 returned error can't find the container with id 78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119
Jul 14 16:00:00.306886 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.306868    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:00:00.690188 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:00.690135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f" event={"ID":"e2c349ab-4758-4dde-b514-4b1a39f51087","Type":"ContainerStarted","Data":"78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119"}
Jul 14 16:00:08.734538 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:08.734452    2564 generic.go:356] "Generic (PLEG): container finished" podID="e2c349ab-4758-4dde-b514-4b1a39f51087" containerID="519fdaa96bed2a1cafd378cc982d104c395c26eccb0803f37a095194ae4001b1" exitCode=0
Jul 14 16:00:08.734538 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:08.734523    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f" event={"ID":"e2c349ab-4758-4dde-b514-4b1a39f51087","Type":"ContainerDied","Data":"519fdaa96bed2a1cafd378cc982d104c395c26eccb0803f37a095194ae4001b1"}
Jul 14 16:00:09.872066 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:09.872040    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"
Jul 14 16:00:10.745780 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:10.745754    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f"
Jul 14 16:00:10.745971 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:10.745802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734080-5wh5f" event={"ID":"e2c349ab-4758-4dde-b514-4b1a39f51087","Type":"ContainerDied","Data":"78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119"}
Jul 14 16:00:10.745971 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:10.745848    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78de9eb33fdad6afadb2a9551a78636d50f8a08021b6945c0eebe7a54cc8c119"
Jul 14 16:00:30.308144 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:30.308100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:00:38.765707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:38.765642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:00:38.894545 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:38.894504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:00:39.805315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:39.805286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:00:50.912405 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:50.912368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:00:54.099903 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:00:54.099873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:01:00.202827 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:00.202787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:01:12.003964 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:12.003921    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:01:12.987548 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:12.987508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:01:14.746377 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:14.746344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:01:34.693769 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:34.693689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:01:34.697755 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:34.697730    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:01:44.111655 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:44.111610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:01:57.105572 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:01:57.105536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:02:02.878422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:02.878375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:02.991323 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:02.991291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:04.498650 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:04.498613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:09.456336 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:09.456298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:09.568299 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:09.568264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:09.670937 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:09.670911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:09.932781 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:09.932748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:16.059094 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:16.059059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:16.160820 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:16.160783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:02:33.795226 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:33.795187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:02:43.295276 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:43.295243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:02:53.503427 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:02:53.503390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:03:03.099970 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:03.099879    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:03:14.195413 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:14.195379    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:03:17.737348 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:17.737304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:03:19.718284 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:19.718248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:03:24.890533 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:24.890499    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:03:34.786119 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:34.786086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:03:35.696364 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:35.696322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:03:45.689395 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:03:45.689358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:04:11.402712 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:04:11.402670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:04:22.803678 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:04:22.803647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:04:47.223804 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:04:47.223720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:04:58.511968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:04:58.511931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:05:15.493725 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:05:15.493687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:05:24.996896 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:05:24.996860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:05:34.995696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:05:34.995660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:05:44.892901 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:05:44.892865    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:05:54.686993 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:05:54.686960    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:06:34.725648 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:06:34.725618    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:06:34.732268 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:06:34.732246    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:06:34.955749 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:06:34.955715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:07:41.289906 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:07:41.289822    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:07:52.292855 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:07:52.292818    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:03.094501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:03.094464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:05.069575 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:05.069543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:08:05.155151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:05.155115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:08:15.000084 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:15.000050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:27.299313 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:27.299270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:36.908604 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:36.908569    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:46.500406 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:46.500366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:08:56.306306 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:08:56.306204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:09:07.406691 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:07.406653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:09:10.761797 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:10.761765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:09:12.068487 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:12.068452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:09:17.892779 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:17.892739    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:09:31.985455 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:31.985423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:09:49.791951 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:49.791915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:09:59.503982 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:09:59.503937    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:10:09.793522 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:10:09.793485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:10:19.695190 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:10:19.695160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:10:29.830175 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:10:29.830096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:10:39.493944 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:10:39.493911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:10:53.486423 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:10:53.486388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:11:01.699082 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:01.699051    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:11:11.985791 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:11.985762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:11:17.132040 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:17.131994    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:11:17.239429 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:17.239399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:11:28.786969 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:28.786932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:11:34.756284 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:34.756245    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:11:34.766134 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:34.766107    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:11:36.594955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:36.594920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:11:50.996578 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:11:50.996543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:12:04.799985 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:12:04.799896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:12:16.496204 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:12:16.496169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:12:29.802575 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:12:29.802542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:12:39.992383 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:12:39.992347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:12:51.400117 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:12:51.400075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:03.892870 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:03.892831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:14.688651 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:14.688564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:14.894209 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:14.894165    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:16.095190 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:16.095121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:24.683043 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:24.683010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:24.706260 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:24.706232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:32.936977 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:32.936890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:33.794783 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:33.794748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:38.180001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:38.179966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:41.442137 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:41.442108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:41.547898 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:41.547870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:41.950704 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:41.950653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:44.549606 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:44.549531    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:48.674883 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.674839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:48.775207 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.775169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:48.899167 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.899146    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:13:48.899529 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.899516    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2c349ab-4758-4dde-b514-4b1a39f51087" containerName="cleanup"
Jul 14 16:13:48.899573 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.899532    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2c349ab-4758-4dde-b514-4b1a39f51087" containerName="cleanup"
Jul 14 16:13:48.899635 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.899616    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2c349ab-4758-4dde-b514-4b1a39f51087" containerName="cleanup"
Jul 14 16:13:48.902700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.902681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.905356 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.905333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9f7be84d-openshift-default-dockercfg-nsf5x\""
Jul 14 16:13:48.935160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.935111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:13:48.937380 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.937355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:48.952131 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc64\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:48.952426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:48.952354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.029190 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.029161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:49.052912 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.052889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.052986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.052924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.052986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.052950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053074 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.052985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053074 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053074 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053074 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053074 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc64\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053516 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053516 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053656 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.053761 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.053735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.055340 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.055322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.055707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.055690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.062336 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.062311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.062537 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.062516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc64\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64\") pod \"e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") " pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.213180 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.213123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:49.368450 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.368422    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:13:49.370363 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:13:49.370333    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec3039f_c23c_47cd_b0dd_e003ca65aa47.slice/crio-8e0bc0a06a5cc734e3a68a45df067729af582a726d11f8e34fb5d961e836a9c7 WatchSource:0}: Error finding container 8e0bc0a06a5cc734e3a68a45df067729af582a726d11f8e34fb5d961e836a9c7: Status 404 returned error can't find the container with id 8e0bc0a06a5cc734e3a68a45df067729af582a726d11f8e34fb5d961e836a9c7
Jul 14 16:13:49.372523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.372492    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:13:49.372642 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.372555    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:13:49.372642 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.372584    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:13:49.915834 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.915793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerStarted","Data":"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"}
Jul 14 16:13:49.916267 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.915853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerStarted","Data":"8e0bc0a06a5cc734e3a68a45df067729af582a726d11f8e34fb5d961e836a9c7"}
Jul 14 16:13:49.942869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:49.942820    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podStartSLOduration=1.942806144 podStartE2EDuration="1.942806144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:13:49.939916534 +0000 UTC m=+1635.685313060" watchObservedRunningTime="2026-07-14 16:13:49.942806144 +0000 UTC m=+1635.688202649"
Jul 14 16:13:50.143243 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.143212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:50.214056 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.213985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:50.218759 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.218739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:50.234262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.234240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:50.397854 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.397830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:50.769768 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.769726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:50.920646 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.920616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:50.921546 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.921526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:13:50.963430 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:50.963384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:51.068062 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:51.068001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:52.522323 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:52.522297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:13:55.211207 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.211171    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:13:55.214415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.214396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:13:55.216836 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.216816    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-62c9m\""
Jul 14 16:13:55.216933 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.216823    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 16:13:55.222699 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.222674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:13:55.304803 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.304779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6\" (UID: \"93b533b3-2782-4fe4-b478-0d896a747bd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:13:55.405853 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.405829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6\" (UID: \"93b533b3-2782-4fe4-b478-0d896a747bd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:13:55.406380 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.406361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6\" (UID: \"93b533b3-2782-4fe4-b478-0d896a747bd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:13:55.526789 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.526729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:13:55.664509 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.664302    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:13:55.946862 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.946830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerStarted","Data":"c5f81ab9530e2867b840f86f87127478535bd88ee965130f2aeadf4f3545bda0"}
Jul 14 16:13:55.946955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.946891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerStarted","Data":"f34daaf43376ae2be995265ba813fc59e1aca634d2edf185f4b32bd4ba6b4065"}
Jul 14 16:13:55.964889 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:55.964843    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" podStartSLOduration=0.964827503 podStartE2EDuration="964.827503ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:13:55.963809204 +0000 UTC m=+1641.709205744" watchObservedRunningTime="2026-07-14 16:13:55.964827503 +0000 UTC m=+1641.710224029"
Jul 14 16:13:56.954574 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:56.954535    2564 generic.go:356] "Generic (PLEG): container finished" podID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerID="c5f81ab9530e2867b840f86f87127478535bd88ee965130f2aeadf4f3545bda0" exitCode=7
Jul 14 16:13:56.954986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:56.954626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerDied","Data":"c5f81ab9530e2867b840f86f87127478535bd88ee965130f2aeadf4f3545bda0"}
Jul 14 16:13:56.954986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:56.954837    2564 scope.go:117] "RemoveContainer" containerID="c5f81ab9530e2867b840f86f87127478535bd88ee965130f2aeadf4f3545bda0"
Jul 14 16:13:57.190047 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:57.190019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:13:57.961195 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:57.961166    2564 generic.go:356] "Generic (PLEG): container finished" podID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerID="c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f" exitCode=7
Jul 14 16:13:57.961622 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:57.961253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerDied","Data":"c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f"}
Jul 14 16:13:57.961622 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:57.961311    2564 scope.go:117] "RemoveContainer" containerID="c5f81ab9530e2867b840f86f87127478535bd88ee965130f2aeadf4f3545bda0"
Jul 14 16:13:57.961622 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:57.961539    2564 scope.go:117] "RemoveContainer" containerID="c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f"
Jul 14 16:13:57.961803 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:13:57.961768    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6_odh-ai-gateway-infra(93b533b3-2782-4fe4-b478-0d896a747bd3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3"
Jul 14 16:13:58.976320 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:13:58.976292    2564 scope.go:117] "RemoveContainer" containerID="c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f"
Jul 14 16:13:58.976704 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:13:58.976471    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6_odh-ai-gateway-infra(93b533b3-2782-4fe4-b478-0d896a747bd3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3"
Jul 14 16:14:05.922105 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:05.922071    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 16:14:05.922627 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:05.922138    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 16:14:06.012533 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.012499    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerID="1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb" exitCode=0
Jul 14 16:14:06.012722 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.012554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerDied","Data":"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"}
Jul 14 16:14:06.012976 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.012957    2564 scope.go:117] "RemoveContainer" containerID="1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"
Jul 14 16:14:06.013913 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.013886    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:14:06.013969 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.013954    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:14:06.014016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:06.013986    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:14:07.019417 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:07.019382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerStarted","Data":"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"}
Jul 14 16:14:07.214353 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:07.214284    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:14:07.214540 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:07.214519    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 16:14:07.214587 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:07.214569    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 16:14:08.214187 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:08.214152    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 16:14:08.214703 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:08.214221    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 16:14:09.213540 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:09.213509    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 16:14:09.213726 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:09.213573    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 16:14:09.763923 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:09.763886    2564 scope.go:117] "RemoveContainer" containerID="c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f"
Jul 14 16:14:10.213485 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:10.213454    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 16:14:10.213627 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:10.213501    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 16:14:11.042390 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.042276    2564 generic.go:356] "Generic (PLEG): container finished" podID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerID="a63beba7678951c9fceb9fc46b5c2083e641a1ace6c9a185c6ecbac4e281dd82" exitCode=0
Jul 14 16:14:11.042390 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.042351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerDied","Data":"a63beba7678951c9fceb9fc46b5c2083e641a1ace6c9a185c6ecbac4e281dd82"}
Jul 14 16:14:11.042943 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.042399    2564 scope.go:117] "RemoveContainer" containerID="c44978760c33f5d986ddc2f2a919a3e4c2db25878c292a6fe1c159de09b8164f"
Jul 14 16:14:11.217793 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.217771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:14:11.218121 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.218106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:14:11.218885 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:11.218868    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:14:12.073051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:12.073019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:14:12.177665 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:12.177644    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:14:12.349530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:12.349467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca\") pod \"93b533b3-2782-4fe4-b478-0d896a747bd3\" (UID: \"93b533b3-2782-4fe4-b478-0d896a747bd3\") "
Jul 14 16:14:12.349802 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:12.349783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93b533b3-2782-4fe4-b478-0d896a747bd3" (UID: "93b533b3-2782-4fe4-b478-0d896a747bd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:14:12.450278 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:12.450254    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93b533b3-2782-4fe4-b478-0d896a747bd3-maas-api-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:14:13.054707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:13.054652    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"
Jul 14 16:14:13.054707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:13.054685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6" event={"ID":"93b533b3-2782-4fe4-b478-0d896a747bd3","Type":"ContainerDied","Data":"f34daaf43376ae2be995265ba813fc59e1aca634d2edf185f4b32bd4ba6b4065"}
Jul 14 16:14:13.054844 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:13.054728    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f34daaf43376ae2be995265ba813fc59e1aca634d2edf185f4b32bd4ba6b4065"
Jul 14 16:14:13.085803 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:13.085779    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:14:13.087455 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:13.087437    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-m76q6"]
Jul 14 16:14:14.769312 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:14.769281    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" path="/var/lib/kubelet/pods/93b533b3-2782-4fe4-b478-0d896a747bd3/volumes"
Jul 14 16:14:45.268197 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268168    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"]
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268475    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268485    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268494    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268499    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268505    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268510    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268571    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.268696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.268580    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:14:45.272754 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.272737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:45.275364 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.275343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-62c9m\""
Jul 14 16:14:45.275491 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.275389    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 16:14:45.280209 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.280183    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"]
Jul 14 16:14:45.281719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.281697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp\" (UID: \"31309cb4-9a78-42af-9a48-b66653aa868b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:45.382723 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.382701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp\" (UID: \"31309cb4-9a78-42af-9a48-b66653aa868b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:45.383217 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.383199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp\" (UID: \"31309cb4-9a78-42af-9a48-b66653aa868b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:45.583450 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.583392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:45.712934 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:45.712905    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"]
Jul 14 16:14:45.714885 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:14:45.714856    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31309cb4_9a78_42af_9a48_b66653aa868b.slice/crio-cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650 WatchSource:0}: Error finding container cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650: Status 404 returned error can't find the container with id cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650
Jul 14 16:14:46.220271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:46.220213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp" event={"ID":"31309cb4-9a78-42af-9a48-b66653aa868b","Type":"ContainerStarted","Data":"1f55096ed2fa58b9b5aa88e7b0932aa6ca7f3ddd3ed9cb38d93891709c68e911"}
Jul 14 16:14:46.220271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:46.220257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp" event={"ID":"31309cb4-9a78-42af-9a48-b66653aa868b","Type":"ContainerStarted","Data":"cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650"}
Jul 14 16:14:46.238806 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:46.238758    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp" podStartSLOduration=1.238744482 podStartE2EDuration="1.238744482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:14:46.237035165 +0000 UTC m=+1691.982431690" watchObservedRunningTime="2026-07-14 16:14:46.238744482 +0000 UTC m=+1691.984141010"
Jul 14 16:14:47.225600 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:47.225572    2564 generic.go:356] "Generic (PLEG): container finished" podID="31309cb4-9a78-42af-9a48-b66653aa868b" containerID="1f55096ed2fa58b9b5aa88e7b0932aa6ca7f3ddd3ed9cb38d93891709c68e911" exitCode=0
Jul 14 16:14:47.225901 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:47.225616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp" event={"ID":"31309cb4-9a78-42af-9a48-b66653aa868b","Type":"ContainerDied","Data":"1f55096ed2fa58b9b5aa88e7b0932aa6ca7f3ddd3ed9cb38d93891709c68e911"}
Jul 14 16:14:48.353747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:48.353726    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:48.400370 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:48.400345    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca\") pod \"31309cb4-9a78-42af-9a48-b66653aa868b\" (UID: \"31309cb4-9a78-42af-9a48-b66653aa868b\") "
Jul 14 16:14:48.400680 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:48.400660    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31309cb4-9a78-42af-9a48-b66653aa868b" (UID: "31309cb4-9a78-42af-9a48-b66653aa868b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:14:48.501339 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:48.501288    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31309cb4-9a78-42af-9a48-b66653aa868b-maas-api-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:14:49.236583 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:49.236559    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp"
Jul 14 16:14:49.236701 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:49.236587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp" event={"ID":"31309cb4-9a78-42af-9a48-b66653aa868b","Type":"ContainerDied","Data":"cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650"}
Jul 14 16:14:49.236701 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:49.236640    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd5bcbdae1ebbb683d5cef8327522869e7c8d2b9cd58b2178988a6dcc82e5650"
Jul 14 16:14:55.749613 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:55.749515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:14:58.506322 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:14:58.506292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:15:00.370826 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:00.370792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:07.153821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:07.153794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:07.234170 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:07.234136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:10.613748 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:10.613714    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:15:10.614104 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:10.613898    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" containerID="cri-o://09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2" gracePeriod=30
Jul 14 16:15:10.630837 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:10.630811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:11.068383 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.068350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:11.220712 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.220685    2564 patch_prober.go:28] interesting pod/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:15:11.220850 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.220743    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:15:11.302506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.302478    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:15:11.302814 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.302801    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31309cb4-9a78-42af-9a48-b66653aa868b" containerName="revoke-keys"
Jul 14 16:15:11.302855 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.302815    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="31309cb4-9a78-42af-9a48-b66653aa868b" containerName="revoke-keys"
Jul 14 16:15:11.302897 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.302879    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b533b3-2782-4fe4-b478-0d896a747bd3" containerName="revoke-keys"
Jul 14 16:15:11.302897 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.302889    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="31309cb4-9a78-42af-9a48-b66653aa868b" containerName="revoke-keys"
Jul 14 16:15:11.305903 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.305885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.310472 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.310452    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-62755357-gw-openshift-default-dockercfg-6scnm\""
Jul 14 16:15:11.327197 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.327139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:15:11.366208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366432 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366432 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366432 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366432 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366432 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.366686 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.366446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xgdl\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467003 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.466972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467003 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467227 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467227 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467227 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467227 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xgdl\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467453 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467453 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467546 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467546 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467546 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467724 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.467852 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.468019 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.467975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.469524 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.469497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.469682 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.469669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.484343 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.484321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.495533 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.495509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xgdl\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl\") pod \"e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") " pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.509457 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.509436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:11.616557 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.616502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:11.624223 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.624202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:11.760379 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.760327    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:15:11.762587 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:15:11.762561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6742dbb_1c9d_46e7_83ee_0cf74ed9129f.slice/crio-44056c85ce97a014f8b73ed60aef514fc346c22cbd9be31863f99cab24dfe80e WatchSource:0}: Error finding container 44056c85ce97a014f8b73ed60aef514fc346c22cbd9be31863f99cab24dfe80e: Status 404 returned error can't find the container with id 44056c85ce97a014f8b73ed60aef514fc346c22cbd9be31863f99cab24dfe80e
Jul 14 16:15:11.764572 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.764543    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:11.764669 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.764623    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:11.764669 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:11.764653    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:12.361371 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.361343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerStarted","Data":"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"}
Jul 14 16:15:12.361546 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.361429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerStarted","Data":"44056c85ce97a014f8b73ed60aef514fc346c22cbd9be31863f99cab24dfe80e"}
Jul 14 16:15:12.400240 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.400193    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podStartSLOduration=1.400180658 podStartE2EDuration="1.400180658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:15:12.399027894 +0000 UTC m=+1718.144424420" watchObservedRunningTime="2026-07-14 16:15:12.400180658 +0000 UTC m=+1718.145577184"
Jul 14 16:15:12.617135 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.617053    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:12.621750 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.621728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:12.634246 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.634224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:12.765733 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:12.765704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:13.067835 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:13.067785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:13.300270 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:13.300244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:13.367398 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:13.367333    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:13.368257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:13.368236    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:13.397375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:13.397348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:15:14.538463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:14.538434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:15:15.896288 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:15.896263    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:15:16.009004 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.008963    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009063    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009096    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009133    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009309 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc64\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009309 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009309 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009258    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009373    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:15:16.009463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009401    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:15:16.009671 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009651    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:15:16.009908 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.009908 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.009791    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket\") pod \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\" (UID: \"8ec3039f-c23c-47cd-b0dd-e003ca65aa47\") "
Jul 14 16:15:16.010145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.010044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:15:16.010145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.010110    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.010145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.010119    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:15:16.010145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.010129    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.010145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.010143    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.011928 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.011906    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:15:16.012018 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.011942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:15:16.012018 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.011967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:15:16.012122 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.012015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64" (OuterVolumeSpecName: "kube-api-access-rbc64") pod "8ec3039f-c23c-47cd-b0dd-e003ca65aa47" (UID: "8ec3039f-c23c-47cd-b0dd-e003ca65aa47"). InnerVolumeSpecName "kube-api-access-rbc64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:15:16.111497 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111459    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc64\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-kube-api-access-rbc64\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.111497 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111493    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.111497 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111503    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.111771 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111511    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.111771 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111522    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.111771 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.111530    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec3039f-c23c-47cd-b0dd-e003ca65aa47-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:15:16.385901 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.385870    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerID="09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2" exitCode=0
Jul 14 16:15:16.386145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.385931    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"
Jul 14 16:15:16.386145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.385932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerDied","Data":"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"}
Jul 14 16:15:16.386145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.386017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v" event={"ID":"8ec3039f-c23c-47cd-b0dd-e003ca65aa47","Type":"ContainerDied","Data":"8e0bc0a06a5cc734e3a68a45df067729af582a726d11f8e34fb5d961e836a9c7"}
Jul 14 16:15:16.386145 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.386043    2564 scope.go:117] "RemoveContainer" containerID="09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"
Jul 14 16:15:16.395807 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.395789    2564 scope.go:117] "RemoveContainer" containerID="1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"
Jul 14 16:15:16.403683 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.403665    2564 scope.go:117] "RemoveContainer" containerID="09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"
Jul 14 16:15:16.403922 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:15:16.403905    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2\": container with ID starting with 09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2 not found: ID does not exist" containerID="09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"
Jul 14 16:15:16.403966 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.403929    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2"} err="failed to get container status \"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2\": rpc error: code = NotFound desc = could not find container \"09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2\": container with ID starting with 09b6825b9ee6c84b388936f2b9654ea551ef086df5fba1c8e0415401929fcff2 not found: ID does not exist"
Jul 14 16:15:16.403966 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.403943    2564 scope.go:117] "RemoveContainer" containerID="1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"
Jul 14 16:15:16.404168 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:15:16.404153    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb\": container with ID starting with 1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb not found: ID does not exist" containerID="1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"
Jul 14 16:15:16.404219 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.404171    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb"} err="failed to get container status \"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb\": rpc error: code = NotFound desc = could not find container \"1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb\": container with ID starting with 1e78150740b6a2913bcc83aa921c057efc62147f45e052565f84c22fe1f84dbb not found: ID does not exist"
Jul 14 16:15:16.413059 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.413039    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:15:16.417120 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.417102    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9f7be84d-openshift-default-6b6447549c-qs84v"]
Jul 14 16:15:16.773528 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:16.773485    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" path="/var/lib/kubelet/pods/8ec3039f-c23c-47cd-b0dd-e003ca65aa47/volumes"
Jul 14 16:15:22.422756 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.422728    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerID="3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056" exitCode=0
Jul 14 16:15:22.423095 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.422811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerDied","Data":"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"}
Jul 14 16:15:22.423172 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.423159    2564 scope.go:117] "RemoveContainer" containerID="3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"
Jul 14 16:15:22.424133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.424107    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:22.424191 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.424170    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:22.424234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:22.424200    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:15:23.434923 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:23.434891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerStarted","Data":"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"}
Jul 14 16:15:23.617069 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:23.617033    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:23.618030 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:23.618007    2564 patch_prober.go:28] interesting pod/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 14 16:15:23.618149 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:23.618051    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 14 16:15:24.617618 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:24.617565    2564 patch_prober.go:28] interesting pod/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 14 16:15:24.617990 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:24.617636    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 14 16:15:25.617826 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:25.617787    2564 patch_prober.go:28] interesting pod/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 14 16:15:25.618210 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:25.617852    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 14 16:15:26.617505 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:26.617473    2564 patch_prober.go:28] interesting pod/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 14 16:15:26.617707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:26.617540    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 14 16:15:27.620770 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:27.620734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:27.621221 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:27.621022    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:15:27.621688 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:15:27.621672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:16:17.437213 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:17.437189    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:16:17.437550 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:17.437394    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy" containerID="cri-o://e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb" gracePeriod=30
Jul 14 16:16:17.455429 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:17.455403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:17.610078 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:17.610039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:20.306226 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:20.306190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:16:22.681236 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.681214    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:16:22.732811 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.732717    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerID="e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb" exitCode=0
Jul 14 16:16:22.732811 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.732777    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"
Jul 14 16:16:22.732811 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.732801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerDied","Data":"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"}
Jul 14 16:16:22.733075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.732879    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7" event={"ID":"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f","Type":"ContainerDied","Data":"44056c85ce97a014f8b73ed60aef514fc346c22cbd9be31863f99cab24dfe80e"}
Jul 14 16:16:22.733075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.732902    2564 scope.go:117] "RemoveContainer" containerID="e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"
Jul 14 16:16:22.741657 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.741639    2564 scope.go:117] "RemoveContainer" containerID="3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"
Jul 14 16:16:22.745874 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.745855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xgdl\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.745993 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.745919    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.745993 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.745960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.745999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746024    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746357 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746308    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:16:22.746418 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746357    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:16:22.746499 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746886 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:16:22.746886 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746638    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket\") pod \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\" (UID: \"e6742dbb-1c9d-46e7-83ee-0cf74ed9129f\") "
Jul 14 16:16:22.746886 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.746836    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:16:22.747203 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.747183    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.747290 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.747209    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.747290 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.747224    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.747290 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.747237    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.747450 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.747370    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:16:22.748461 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.748427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:16:22.748560 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.748514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:16:22.748883 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.748860    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl" (OuterVolumeSpecName: "kube-api-access-2xgdl") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "kube-api-access-2xgdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:16:22.749043 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.749026    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" (UID: "e6742dbb-1c9d-46e7-83ee-0cf74ed9129f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:16:22.750503 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.750483    2564 scope.go:117] "RemoveContainer" containerID="e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"
Jul 14 16:16:22.750906 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:16:22.750888    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb\": container with ID starting with e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb not found: ID does not exist" containerID="e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"
Jul 14 16:16:22.750960 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.750914    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb"} err="failed to get container status \"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb\": rpc error: code = NotFound desc = could not find container \"e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb\": container with ID starting with e8f77f72fd9a7a4e14c939b0fc0c9232f03cda536847c465c8e86db79f8c4bfb not found: ID does not exist"
Jul 14 16:16:22.750960 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.750931    2564 scope.go:117] "RemoveContainer" containerID="3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"
Jul 14 16:16:22.751195 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:16:22.751174    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056\": container with ID starting with 3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056 not found: ID does not exist" containerID="3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"
Jul 14 16:16:22.751263 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.751202    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056"} err="failed to get container status \"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056\": rpc error: code = NotFound desc = could not find container \"3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056\": container with ID starting with 3010063f9bd26d23fa68651ad7217ddfb9a0d7e77f6a1b3f5e8bbdb523752056 not found: ID does not exist"
Jul 14 16:16:22.848013 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.847988    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xgdl\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-kube-api-access-2xgdl\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.848013 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.848014    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.848013 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.848027    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.848287 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.848035    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:22.848287 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:22.848043    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:16:23.051885 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:23.051804    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:16:23.057888 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:23.057858    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-62755357-gw-openshift-default-5559cdbfcf-h5hf7"]
Jul 14 16:16:23.227562 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:23.227513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:24.240738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:24.240706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:24.340722 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:24.340694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:24.769007 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:24.768978    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" path="/var/lib/kubelet/pods/e6742dbb-1c9d-46e7-83ee-0cf74ed9129f/volumes"
Jul 14 16:16:30.830000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:30.829929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:30.937879 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:30.937849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:31.152200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152119    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:16:31.152480 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152465    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152482    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152493    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152500    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152506    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152512    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152519    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152524    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.152586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152584    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.153001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152611    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6742dbb-1c9d-46e7-83ee-0cf74ed9129f" containerName="istio-proxy"
Jul 14 16:16:31.153001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152621    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.153001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.152628    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec3039f-c23c-47cd-b0dd-e003ca65aa47" containerName="istio-proxy"
Jul 14 16:16:31.157211 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.157193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.171860 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.171839    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7254e6a1-openshift-default-dockercfg-8dzw8\""
Jul 14 16:16:31.216952 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.216926    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:16:31.221856 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.221964 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.221964 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.221964 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.222075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.222075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.221998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.222075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.222043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.222075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.222067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfln\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.222200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.222103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.259029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.259003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:31.323148 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323259 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323259 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323259 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323259 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323464 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323464 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323566 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfln\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323566 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323748 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323748 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323929 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.323929 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.324039 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.323976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.326315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.326270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.326426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.326311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.349850 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.349825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.350053 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.350031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfln\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln\") pod \"e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") " pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.359637 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.359611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:31.467902 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.467880    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:31.614937 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.614911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:16:31.617722 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:16:31.617693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabbbd3e_b7ea_44ff_9ffe_3337ff9c629a.slice/crio-dc0a1446ee6e1a848bcf975b6eb35a56fe9692db1a8c6807643ea63aec26fed7 WatchSource:0}: Error finding container dc0a1446ee6e1a848bcf975b6eb35a56fe9692db1a8c6807643ea63aec26fed7: Status 404 returned error can't find the container with id dc0a1446ee6e1a848bcf975b6eb35a56fe9692db1a8c6807643ea63aec26fed7
Jul 14 16:16:31.619851 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.619824    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:31.619926 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.619883    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:31.619926 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.619912    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:31.782911 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.782791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerStarted","Data":"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"}
Jul 14 16:16:31.782911 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.782859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerStarted","Data":"dc0a1446ee6e1a848bcf975b6eb35a56fe9692db1a8c6807643ea63aec26fed7"}
Jul 14 16:16:31.812124 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:31.812069    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podStartSLOduration=0.812048474 podStartE2EDuration="812.048474ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:16:31.808954433 +0000 UTC m=+1797.554350960" watchObservedRunningTime="2026-07-14 16:16:31.812048474 +0000 UTC m=+1797.557444981"
Jul 14 16:16:32.415574 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.415545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:32.468291 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.468256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:32.473079 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.473057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:32.555997 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.555964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:32.711364 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.711259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:32.788233 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.788203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:32.789079 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:32.789064    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:33.359263 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:33.359233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:33.593552 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:33.593523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:33.705005 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:33.704976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:34.789273 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:34.789245    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:16:34.800719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:34.800695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:16:34.944646 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:34.944613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:16:35.257094 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:35.257064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:42.912547 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:42.912514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:43.006440 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.006414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:43.845001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.844973    2564 generic.go:356] "Generic (PLEG): container finished" podID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerID="96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721" exitCode=0
Jul 14 16:16:43.845147 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.845047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerDied","Data":"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"}
Jul 14 16:16:43.845431 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.845413    2564 scope.go:117] "RemoveContainer" containerID="96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"
Jul 14 16:16:43.846342 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.846317    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:43.846411 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.846379    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:43.846449 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:43.846413    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:16:44.852082 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:44.852047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerStarted","Data":"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"}
Jul 14 16:16:45.470307 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:45.470265    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:45.470734 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:45.470707    2564 patch_prober.go:28] interesting pod/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 16:16:45.470921 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:45.470896    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 16:16:46.468946 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:46.468907    2564 patch_prober.go:28] interesting pod/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 16:16:46.469537 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:46.469507    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 16:16:47.469227 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:47.469182    2564 patch_prober.go:28] interesting pod/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 16:16:47.469720 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:47.469264    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 16:16:47.789170 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:47.789076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:48.469517 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:48.469479    2564 patch_prober.go:28] interesting pod/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 16:16:48.470111 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:48.470077    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 16:16:49.471799 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:49.471770    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:49.472815 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:49.472798    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:16:54.498731 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:54.498694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:16:54.599613 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:16:54.599572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:17:48.343013 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:17:48.342974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:17:51.418718 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:17:51.418685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:17:52.807147 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:17:52.807114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:17:59.071064 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:17:59.071033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:17:59.143284 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:17:59.143217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:03.941086 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:03.941052    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:18:03.941463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:03.941221    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" containerID="cri-o://a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf" gracePeriod=30
Jul 14 16:18:03.968075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:03.968043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:04.294971 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.294895    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:18:04.298217 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.298198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.301392 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.301371    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b8cdb4a9-openshift-default-dockercfg-4nbng\""
Jul 14 16:18:04.312272 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.312250    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:18:04.328947 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.328908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:04.450177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqdj\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450375 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.450566 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.450397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.474077 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.474052    2564 patch_prober.go:28] interesting pod/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:18:04.474193 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.474100    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:18:04.551955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.551887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.551955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.551915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.551955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.551951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqdj\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552139 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552139 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552291 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552346 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552399 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552399 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552544 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552544 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552694 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.552912 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.552895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.554617 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.554569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.554737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.554716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.561457 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.561438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.561561 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.561476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqdj\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj\") pod \"e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") " pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.608688 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.608669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:04.751712 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.751684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:18:04.752550 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:18:04.752528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc440f77f_a7ef_432c_bee5_1435e7ce5619.slice/crio-e7b28ec744a9e14721cfa2a73ad12f9c643a008aa084c430353976c90eba957c WatchSource:0}: Error finding container e7b28ec744a9e14721cfa2a73ad12f9c643a008aa084c430353976c90eba957c: Status 404 returned error can't find the container with id e7b28ec744a9e14721cfa2a73ad12f9c643a008aa084c430353976c90eba957c
Jul 14 16:18:04.754828 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.754797    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:04.754919 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.754859    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:04.754919 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:04.754890    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:05.278512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.278481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerStarted","Data":"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"}
Jul 14 16:18:05.278992 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.278530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerStarted","Data":"e7b28ec744a9e14721cfa2a73ad12f9c643a008aa084c430353976c90eba957c"}
Jul 14 16:18:05.303586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.303537    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podStartSLOduration=1.303524029 podStartE2EDuration="1.303524029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:18:05.302126224 +0000 UTC m=+1891.047522753" watchObservedRunningTime="2026-07-14 16:18:05.303524029 +0000 UTC m=+1891.048920555"
Jul 14 16:18:05.576966 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.576890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:05.609249 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.609219    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:05.613944 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.613921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:05.673814 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.673785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:05.873701 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:05.873622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:06.283722 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:06.283697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:06.284698 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:06.284677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:06.313022 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:06.312992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:06.386305 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:06.386277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:08.104891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:08.104858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:18:09.213300 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.213236    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:18:09.289171 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289281    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289318    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289350    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289377    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289407    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdfln\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289463    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289867 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.289867 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.289511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs\") pod \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\" (UID: \"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a\") "
Jul 14 16:18:09.290055 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.290026    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:18:09.290202 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.290036    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:18:09.290395 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.290368    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:18:09.290683 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.290662    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:18:09.291016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.290991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:18:09.294101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.294023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:18:09.294101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.294023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:18:09.294101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.294082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:18:09.294264 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.294125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln" (OuterVolumeSpecName: "kube-api-access-pdfln") pod "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" (UID: "fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a"). InnerVolumeSpecName "kube-api-access-pdfln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:18:09.306865 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.306834    2564 generic.go:356] "Generic (PLEG): container finished" podID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerID="a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf" exitCode=0
Jul 14 16:18:09.306968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.306938    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"
Jul 14 16:18:09.307039 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.306951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerDied","Data":"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"}
Jul 14 16:18:09.307039 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.307031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7" event={"ID":"fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a","Type":"ContainerDied","Data":"dc0a1446ee6e1a848bcf975b6eb35a56fe9692db1a8c6807643ea63aec26fed7"}
Jul 14 16:18:09.307148 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.307062    2564 scope.go:117] "RemoveContainer" containerID="a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"
Jul 14 16:18:09.316523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.316506    2564 scope.go:117] "RemoveContainer" containerID="96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"
Jul 14 16:18:09.325214 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.325199    2564 scope.go:117] "RemoveContainer" containerID="a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"
Jul 14 16:18:09.325470 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:18:09.325452    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf\": container with ID starting with a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf not found: ID does not exist" containerID="a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"
Jul 14 16:18:09.325523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.325478    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf"} err="failed to get container status \"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf\": rpc error: code = NotFound desc = could not find container \"a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf\": container with ID starting with a25201503f526220e53d9901a9617817b3ae18280c72c2456d352e4069d95fcf not found: ID does not exist"
Jul 14 16:18:09.325523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.325495    2564 scope.go:117] "RemoveContainer" containerID="96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"
Jul 14 16:18:09.325783 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:18:09.325767    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721\": container with ID starting with 96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721 not found: ID does not exist" containerID="96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"
Jul 14 16:18:09.325844 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.325791    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721"} err="failed to get container status \"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721\": rpc error: code = NotFound desc = could not find container \"96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721\": container with ID starting with 96b9603775395befde99f00dfbc97f1abc587d9c63205710c8a2c1fbd452d721 not found: ID does not exist"
Jul 14 16:18:09.336572 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.336546    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:18:09.341462 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.341442    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7254e6a1-openshift-default-67576fc8f-6ndf7"]
Jul 14 16:18:09.390617 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390550    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390617 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390581    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390626    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390642    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390653    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdfln\" (UniqueName: \"kubernetes.io/projected/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-kube-api-access-pdfln\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390666    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390677    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390690    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.390842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.390701    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:18:09.741260 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.741208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:09.797660 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:09.797631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:10.773547 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:10.773504    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" path="/var/lib/kubelet/pods/fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a/volumes"
Jul 14 16:18:15.364522 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:15.364486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:15.430983 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:15.430951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:16.346653 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.346577    2564 generic.go:356] "Generic (PLEG): container finished" podID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerID="b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b" exitCode=0
Jul 14 16:18:16.346796 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.346657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerDied","Data":"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"}
Jul 14 16:18:16.347163 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.347147    2564 scope.go:117] "RemoveContainer" containerID="b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"
Jul 14 16:18:16.348236 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.348208    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:16.348307 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.348291    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:16.348348 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:16.348336    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:18:17.357479 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:17.357430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerStarted","Data":"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"}
Jul 14 16:18:17.609422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:17.609336    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:17.610573 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:17.610546    2564 patch_prober.go:28] interesting pod/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 14 16:18:17.610712 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:17.610612    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 14 16:18:18.609071 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:18.609036    2564 patch_prober.go:28] interesting pod/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 14 16:18:18.609508 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:18.609124    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 14 16:18:18.807153 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:18.807115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:18:19.609450 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:19.609417    2564 patch_prober.go:28] interesting pod/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 14 16:18:19.609937 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:19.609472    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 14 16:18:20.609706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:20.609672    2564 patch_prober.go:28] interesting pod/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 14 16:18:20.610095 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:20.609728    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 14 16:18:21.284343 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:21.284311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:21.613194 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:21.613128    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:18:21.614224 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:18:21.614201    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:19:20.546581 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:20.546544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:22.997263 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:22.997231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:19:25.032397 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:25.032369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:31.491945 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:31.491867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:31.590107 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:31.590079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:35.216175 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:35.216140    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:19:35.216542 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:35.216321    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" containerID="cri-o://1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4" gracePeriod=30
Jul 14 16:19:35.251509 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:35.251479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:35.897771 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:35.897734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:36.012062 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:36.012031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:36.116682 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:36.116655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:36.616114 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:36.616076    2564 patch_prober.go:28] interesting pod/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:19:36.616473 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:36.616144    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:19:37.592901 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:37.592853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:40.467196 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.467177    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:19:40.480737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480845 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480845 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480845 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.480986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480980    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlqdj\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.481123 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.481123 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481032    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy\") pod \"c440f77f-a7ef-432c-bee5-1435e7ce5619\" (UID: \"c440f77f-a7ef-432c-bee5-1435e7ce5619\") "
Jul 14 16:19:40.481378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.480995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:19:40.481378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481335    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.481378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:19:40.481614 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:19:40.481852 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481834    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data" (OuterVolumeSpecName: "istio-data") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:19:40.481956 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.481932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:19:40.483236 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.483209    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token" (OuterVolumeSpecName: "istio-token") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:19:40.483339 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.483252    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj" (OuterVolumeSpecName: "kube-api-access-nlqdj") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "kube-api-access-nlqdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:19:40.483626 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.483607    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:19:40.483707 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.483688    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c440f77f-a7ef-432c-bee5-1435e7ce5619" (UID: "c440f77f-a7ef-432c-bee5-1435e7ce5619"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:19:40.581774 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581730    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlqdj\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-kube-api-access-nlqdj\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581774 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581772    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581786    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581799    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581812    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581822    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c440f77f-a7ef-432c-bee5-1435e7ce5619-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581833    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c440f77f-a7ef-432c-bee5-1435e7ce5619-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.581957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.581844    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c440f77f-a7ef-432c-bee5-1435e7ce5619-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:19:40.793954 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.793924    2564 generic.go:356] "Generic (PLEG): container finished" podID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerID="1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4" exitCode=0
Jul 14 16:19:40.794064 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.793988    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"
Jul 14 16:19:40.794064 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.794014    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerDied","Data":"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"}
Jul 14 16:19:40.794149 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.794099    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw" event={"ID":"c440f77f-a7ef-432c-bee5-1435e7ce5619","Type":"ContainerDied","Data":"e7b28ec744a9e14721cfa2a73ad12f9c643a008aa084c430353976c90eba957c"}
Jul 14 16:19:40.794149 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.794128    2564 scope.go:117] "RemoveContainer" containerID="1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"
Jul 14 16:19:40.803173 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.803154    2564 scope.go:117] "RemoveContainer" containerID="b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"
Jul 14 16:19:40.811150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.811108    2564 scope.go:117] "RemoveContainer" containerID="1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"
Jul 14 16:19:40.811660 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:19:40.811559    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4\": container with ID starting with 1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4 not found: ID does not exist" containerID="1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"
Jul 14 16:19:40.811747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.811670    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4"} err="failed to get container status \"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4\": rpc error: code = NotFound desc = could not find container \"1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4\": container with ID starting with 1b95fe848bfb01cdad8310c06fe834e631e26f32f0b1e1ba787b62f577df65c4 not found: ID does not exist"
Jul 14 16:19:40.811747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.811695    2564 scope.go:117] "RemoveContainer" containerID="b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"
Jul 14 16:19:40.812014 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:19:40.811992    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b\": container with ID starting with b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b not found: ID does not exist" containerID="b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"
Jul 14 16:19:40.812071 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.812023    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b"} err="failed to get container status \"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b\": rpc error: code = NotFound desc = could not find container \"b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b\": container with ID starting with b6280d46e8aeafe7b086a153b77c611a8d9ed0e6b4abbf3456d82744ede8809b not found: ID does not exist"
Jul 14 16:19:40.814165 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.814147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:19:40.818222 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:40.818201    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b8cdb4a9-openshift-default-7df4b6f7d7-c2xxw"]
Jul 14 16:19:41.668753 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:41.668723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:42.768764 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:42.768729    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" path="/var/lib/kubelet/pods/c440f77f-a7ef-432c-bee5-1435e7ce5619/volumes"
Jul 14 16:19:44.261818 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:44.261785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:44.338525 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:44.338493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:44.452977 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:44.452946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:44.571300 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:44.571233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:19:45.055892 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:19:45.055861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:00.853264 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:00.853233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:11.051717 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:11.051681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:15.169695 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:15.169654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:17.250792 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:17.250742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:17.361004 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:17.360950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:17.447766 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:17.447736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:33.451654 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:33.451609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:34.883002 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:34.882961    2564 scope.go:117] "RemoveContainer" containerID="a63beba7678951c9fceb9fc46b5c2083e641a1ace6c9a185c6ecbac4e281dd82"
Jul 14 16:20:39.449681 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:39.449642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:39.558212 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:39.558176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:39.651309 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:39.651275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:42.102060 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:42.102029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:42.211769 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:42.211738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:50.214513 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:50.214477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:51.140519 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:51.140476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:57.221470 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:57.221388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:57.320446 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:57.320422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:57.419081 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:57.419054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:57.518819 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:57.518742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:58.442749 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:58.442722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:58.548809 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:58.548783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:20:59.696210 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:20:59.696179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:21:00.389869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:00.389835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:06.768406 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:06.768369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:06.869155 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:06.869128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:07.199424 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:07.199399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:21:07.473773 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:07.473711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:15.225584 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:15.225547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:21:15.561941 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:15.561850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:15.646165 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:15.646137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:15.842443 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:15.842359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:16.256451 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256427    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:21:16.256781 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256773    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:21:16.256821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256786    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:21:16.256821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256801    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.256821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256806    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.256821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256811    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.256821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256818    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.256963 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256872    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:21:16.256963 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256881    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:21:16.256963 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256888    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.256963 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.256893    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabbbd3e-b7ea-44ff-9ffe-3337ff9c629a" containerName="istio-proxy"
Jul 14 16:21:16.259739 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.259722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.262938 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.262907    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d453a59f-openshift-default-dockercfg-tcq4s\""
Jul 14 16:21:16.271283 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271551 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271551 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvl9\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271551 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271679 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.271679 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.271567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.280703 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.280682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:16.339506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.339474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:21:16.372304 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372304 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvl9\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.372831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.373060 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.372885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.373060 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.373028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.373324 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.373106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.374702 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.374684    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.375014 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.374995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.380994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.380973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.381847 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.381825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvl9\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9\") pod \"e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") " pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.569822 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.569771    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:16.742734 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:21:16.742698    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad2a739_2eba_4e59_9d9f_fcddc500c3da.slice/crio-783ab325dc6f17fe25929ca6bd60cb296d7231365d77c6c1044294ce9fede178 WatchSource:0}: Error finding container 783ab325dc6f17fe25929ca6bd60cb296d7231365d77c6c1044294ce9fede178: Status 404 returned error can't find the container with id 783ab325dc6f17fe25929ca6bd60cb296d7231365d77c6c1044294ce9fede178
Jul 14 16:21:16.745017 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.744986    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:16.745101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.745056    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:16.745101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.745085    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:16.746489 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:16.746467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:21:17.066366 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.066317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:17.289751 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.289715    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerStarted","Data":"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"}
Jul 14 16:21:17.290139 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.289779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerStarted","Data":"783ab325dc6f17fe25929ca6bd60cb296d7231365d77c6c1044294ce9fede178"}
Jul 14 16:21:17.318402 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.318296    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podStartSLOduration=1.3182721050000001 podStartE2EDuration="1.318272105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:21:17.315750302 +0000 UTC m=+2083.061146828" watchObservedRunningTime="2026-07-14 16:21:17.318272105 +0000 UTC m=+2083.063668609"
Jul 14 16:21:17.570571 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.570505    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:17.575026 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:17.575004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:18.300419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:18.299023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:18.301792 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:18.301766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:19.373569 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:19.373540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:19.456277 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:19.456249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:19.555634 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:19.555588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:19.923329 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:19.923304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:20.077866 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:20.077837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:20.181540 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:20.181478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:23.920880 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:23.920850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:24.692199 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:24.692166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:24.793022 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:24.792996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:25.177207 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:25.177181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:26.541079 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:26.541000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:21:31.379696 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:31.379662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:31.443968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:31.443943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:34.340745 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:34.340708    2564 patch_prober.go:28] interesting pod/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 16:21:34.341101 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:34.340786    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 16:21:34.821609 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:34.821574    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:21:34.833456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:34.833438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:21:35.389081 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.389055    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerID="777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7" exitCode=0
Jul 14 16:21:35.389563 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.389107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerDied","Data":"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"}
Jul 14 16:21:35.389563 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.389513    2564 scope.go:117] "RemoveContainer" containerID="777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"
Jul 14 16:21:35.390475 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.390445    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:35.390569 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.390532    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:35.390662 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:35.390581    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:21:36.396869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:36.396830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerStarted","Data":"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"}
Jul 14 16:21:36.571150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:36.571049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:36.571800 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:36.571449    2564 patch_prober.go:28] interesting pod/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 14 16:21:36.571800 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:36.571499    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 14 16:21:37.570835 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:37.570700    2564 patch_prober.go:28] interesting pod/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 14 16:21:37.572637 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:37.571456    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 14 16:21:38.570896 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:38.570849    2564 patch_prober.go:28] interesting pod/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 14 16:21:38.571412 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:38.570930    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 14 16:21:39.570647 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:39.570585    2564 patch_prober.go:28] interesting pod/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 14 16:21:39.570851 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:39.570670    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 14 16:21:40.573458 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:40.573427    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:40.573864 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:40.573805    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:40.574543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:40.574522    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:21:41.880387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:41.880354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:43.712941 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:43.712904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:43.811955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:43.811929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:44.990958 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:44.990912    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:21:46.895515 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:46.895486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:53.208564 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:53.208534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:53.311809 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:53.311781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:57.682103 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:57.682074    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:21:57.682738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:57.682277    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy" containerID="cri-o://03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e" gracePeriod=30
Jul 14 16:21:57.710549 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:57.710519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:57.983768 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:57.983684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:58.143653 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:58.143613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:58.232648 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:58.232621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:21:58.413310 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:21:58.413289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:02.928732 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:02.928708    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:22:03.023776 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.023776 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkvl9\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.023968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023777    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.023968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023902    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.023968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.024133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.023979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.024133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024014    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:22:03.024133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024077    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.024133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.024133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024133    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs\") pod \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\" (UID: \"1ad2a739-2eba-4e59-9d9f-fcddc500c3da\") "
Jul 14 16:22:03.024369 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:22:03.024369 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024297    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:22:03.024463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:22:03.024617 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024526    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.024677 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024624    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.024677 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024639    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.024759 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.024681    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.025429 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.025398    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:22:03.026133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.026082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:22:03.026248 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.026216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9" (OuterVolumeSpecName: "kube-api-access-pkvl9") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "kube-api-access-pkvl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:22:03.026310 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.026262    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:22:03.026449 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.026434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ad2a739-2eba-4e59-9d9f-fcddc500c3da" (UID: "1ad2a739-2eba-4e59-9d9f-fcddc500c3da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:22:03.125872 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.125852    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.125872 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.125872    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.125994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.125881    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.125994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.125889    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkvl9\" (UniqueName: \"kubernetes.io/projected/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-kube-api-access-pkvl9\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.125994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.125897    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad2a739-2eba-4e59-9d9f-fcddc500c3da-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:22:03.531068 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.531043    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerID="03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e" exitCode=0
Jul 14 16:22:03.531196 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.531089    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"
Jul 14 16:22:03.531196 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.531136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerDied","Data":"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"}
Jul 14 16:22:03.531323 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.531198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp" event={"ID":"1ad2a739-2eba-4e59-9d9f-fcddc500c3da","Type":"ContainerDied","Data":"783ab325dc6f17fe25929ca6bd60cb296d7231365d77c6c1044294ce9fede178"}
Jul 14 16:22:03.531323 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.531230    2564 scope.go:117] "RemoveContainer" containerID="03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"
Jul 14 16:22:03.540126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.540110    2564 scope.go:117] "RemoveContainer" containerID="777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"
Jul 14 16:22:03.547784 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.547766    2564 scope.go:117] "RemoveContainer" containerID="03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"
Jul 14 16:22:03.548041 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:22:03.548021    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e\": container with ID starting with 03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e not found: ID does not exist" containerID="03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"
Jul 14 16:22:03.548091 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.548051    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e"} err="failed to get container status \"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e\": rpc error: code = NotFound desc = could not find container \"03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e\": container with ID starting with 03d2948c000a94974298d0816808cb433ad5d95a45a9164dd060077e798c564e not found: ID does not exist"
Jul 14 16:22:03.548091 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.548067    2564 scope.go:117] "RemoveContainer" containerID="777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"
Jul 14 16:22:03.548287 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:22:03.548271    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7\": container with ID starting with 777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7 not found: ID does not exist" containerID="777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"
Jul 14 16:22:03.548339 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.548290    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7"} err="failed to get container status \"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7\": rpc error: code = NotFound desc = could not find container \"777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7\": container with ID starting with 777097b2c03cda374f8b0ddd755e29689d78fa7c6fae09a4a020464cc66224a7 not found: ID does not exist"
Jul 14 16:22:03.565975 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.565955    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:22:03.570422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:03.570402    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d453a59f-openshift-default-6c4cfb8ff-jrdtp"]
Jul 14 16:22:04.694174 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:04.694142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:04.776244 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:04.776210    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" path="/var/lib/kubelet/pods/1ad2a739-2eba-4e59-9d9f-fcddc500c3da/volumes"
Jul 14 16:22:04.799877 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:04.799850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:04.893388 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:04.893352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:05.140815 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:05.140728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:11.338745 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:11.338715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:11.426849 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:11.426819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:18.677919 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:18.677883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:19.024284 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024207    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:22:19.024538 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024526    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.024610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024540    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.024610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024556    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:22:19.024610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024561    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c440f77f-a7ef-432c-bee5-1435e7ce5619" containerName="istio-proxy"
Jul 14 16:22:19.024610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024567    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.024610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.024790 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024649    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.024790 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.024656    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad2a739-2eba-4e59-9d9f-fcddc500c3da" containerName="istio-proxy"
Jul 14 16:22:19.026692 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.026675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.029428 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.029408    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ad3a3819-openshift-default-dockercfg-xv9fj\""
Jul 14 16:22:19.040970 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.040944    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:22:19.063743 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.063699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:19.148962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.148929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.148962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.148968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28r5\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149396 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.149396 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.149273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250166 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250330 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250330 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250461 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250461 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250461 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250461 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28r5\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250854 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250910 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.250961 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.250907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.251380 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.251354    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.252894 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.252877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.252955 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.252926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.259663 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.259642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28r5\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.259929 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.259906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token\") pod \"e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") " pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.337070 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.336989    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:19.475960 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.475932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:22:19.476914 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:22:19.476889    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec5182d_aeda_4dc1_aae4_45b9c1bcd723.slice/crio-9a2752dcd15ae8b768fe8e6e13c966f7327e6f3a47c575ae44e8c762b4a9fe03 WatchSource:0}: Error finding container 9a2752dcd15ae8b768fe8e6e13c966f7327e6f3a47c575ae44e8c762b4a9fe03: Status 404 returned error can't find the container with id 9a2752dcd15ae8b768fe8e6e13c966f7327e6f3a47c575ae44e8c762b4a9fe03
Jul 14 16:22:19.479127 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.479094    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:19.479234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.479156    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:19.479234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.479183    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:19.622223 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.622132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerStarted","Data":"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"}
Jul 14 16:22:19.622223 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.622184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerStarted","Data":"9a2752dcd15ae8b768fe8e6e13c966f7327e6f3a47c575ae44e8c762b4a9fe03"}
Jul 14 16:22:19.646442 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.646387    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podStartSLOduration=0.646370305 podStartE2EDuration="646.370305ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:22:19.643094215 +0000 UTC m=+2145.388490741" watchObservedRunningTime="2026-07-14 16:22:19.646370305 +0000 UTC m=+2145.391766831"
Jul 14 16:22:19.719772 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:19.719734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:20.338076 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:20.338041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:20.343410 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:20.343386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:20.628081 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:20.627991    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:20.628853 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:20.628836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:21.736134 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:21.736105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:21.812476 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:21.812446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:21.890478 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:21.890447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:22.194967 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:22.194933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:22.513664 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:22.513560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:22.612872 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:22.612846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:26.379333 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:26.379297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:27.494380 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:27.494341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:22:35.919247 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:35.919209    2564 patch_prober.go:28] interesting pod/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:46428->10.132.0.48:15021: read: connection reset by peer" start-of-body=
Jul 14 16:22:35.919658 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:35.919282    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:46428->10.132.0.48:15021: read: connection reset by peer"
Jul 14 16:22:36.718225 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.718193    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerID="994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd" exitCode=0
Jul 14 16:22:36.718420 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.718264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerDied","Data":"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"}
Jul 14 16:22:36.718702 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.718688    2564 scope.go:117] "RemoveContainer" containerID="994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"
Jul 14 16:22:36.719690 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.719665    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:36.719773 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.719729    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:36.719773 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:36.719763    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:22:37.725637 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:37.725580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerStarted","Data":"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"}
Jul 14 16:22:38.337975 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:38.337941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:38.338156 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:38.338045    2564 patch_prober.go:28] interesting pod/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 14 16:22:38.338156 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:38.338097    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 14 16:22:39.337994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:39.337960    2564 patch_prober.go:28] interesting pod/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 14 16:22:39.338391 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:39.338016    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 14 16:22:40.337899 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:40.337864    2564 patch_prober.go:28] interesting pod/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 14 16:22:40.338108 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:40.337926    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 14 16:22:41.337868 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:41.337828    2564 patch_prober.go:28] interesting pod/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 14 16:22:41.338069 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:41.337899    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 14 16:22:42.341523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:42.341493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:42.341945 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:42.341810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:42.342464 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:42.342447    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:22:43.328766 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:43.328734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:22:47.098964 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:22:47.098930    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:23:37.760615 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:23:37.760565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:23:51.884285 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:23:51.884220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:23:55.835941 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:23:55.835843    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:23:56.188054 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:23:56.188017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:01.222471 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:01.222434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:18.676000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:18.675955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:38.064841 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:38.064806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:39.511214 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:39.511150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:46.735219 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:46.735179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:46.861483 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:46.861440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:58.706168 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:58.706138    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:24:58.706563 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:58.706371    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy" containerID="cri-o://b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc" gracePeriod=30
Jul 14 16:24:58.738291 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:58.738254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:24:58.968750 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:24:58.968660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:00.142618 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:00.142535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:00.235872 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:00.235847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:01.228728 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:01.228690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:01.340788 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:01.340756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:01.447106 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:01.447077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:02.976356 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:02.976308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:03.006572 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:03.006540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:25:03.961692 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:03.961670    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:25:04.126447 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126447 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126447 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126435    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n28r5\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126455    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126500    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126529    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token\") pod \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\" (UID: \"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723\") "
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126897    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:25:04.126950 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.126897    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:25:04.127529 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.127001    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:25:04.127529 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.127076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:25:04.127671 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.127613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:25:04.128866 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.128837    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:25:04.128991 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.128964    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:25:04.129127 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.129107    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:25:04.129212 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.129198    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5" (OuterVolumeSpecName: "kube-api-access-n28r5") pod "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" (UID: "6ec5182d-aeda-4dc1-aae4-45b9c1bcd723"). InnerVolumeSpecName "kube-api-access-n28r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:25:04.227934 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227903    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.227934 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227926    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.227934 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227935    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227943    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227951    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227958    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n28r5\" (UniqueName: \"kubernetes.io/projected/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-kube-api-access-n28r5\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227967    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227976    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.228160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.227984    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:25:04.521520 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.521490    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerID="b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc" exitCode=0
Jul 14 16:25:04.521747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.521558    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"
Jul 14 16:25:04.521747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.521573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerDied","Data":"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"}
Jul 14 16:25:04.521747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.521687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd" event={"ID":"6ec5182d-aeda-4dc1-aae4-45b9c1bcd723","Type":"ContainerDied","Data":"9a2752dcd15ae8b768fe8e6e13c966f7327e6f3a47c575ae44e8c762b4a9fe03"}
Jul 14 16:25:04.521747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.521712    2564 scope.go:117] "RemoveContainer" containerID="b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"
Jul 14 16:25:04.531952 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.531934    2564 scope.go:117] "RemoveContainer" containerID="994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"
Jul 14 16:25:04.540662 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.540644    2564 scope.go:117] "RemoveContainer" containerID="b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"
Jul 14 16:25:04.540939 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:25:04.540920    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc\": container with ID starting with b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc not found: ID does not exist" containerID="b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"
Jul 14 16:25:04.540996 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.540948    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc"} err="failed to get container status \"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc\": rpc error: code = NotFound desc = could not find container \"b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc\": container with ID starting with b6970d56ae4e979bfebfd2b92adf549f2dcbec4d77bdc925c59c8c9a23b64bbc not found: ID does not exist"
Jul 14 16:25:04.540996 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.540966    2564 scope.go:117] "RemoveContainer" containerID="994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"
Jul 14 16:25:04.541258 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:25:04.541234    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd\": container with ID starting with 994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd not found: ID does not exist" containerID="994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"
Jul 14 16:25:04.541316 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.541264    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd"} err="failed to get container status \"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd\": rpc error: code = NotFound desc = could not find container \"994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd\": container with ID starting with 994894da6b0a07047577ce6b293a9a7698ed94098f817f253afe2b957267b3fd not found: ID does not exist"
Jul 14 16:25:04.553406 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.550055    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:25:04.553714 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.553693    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ad3a3819-openshift-default-6f999f747-9bjrd"]
Jul 14 16:25:04.769240 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:04.769212    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" path="/var/lib/kubelet/pods/6ec5182d-aeda-4dc1-aae4-45b9c1bcd723/volumes"
Jul 14 16:25:10.278686 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:10.278641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:10.380867 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:10.380829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:11.071986 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:11.071950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:15.531527 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:15.531491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:25:19.351862 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:19.351829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:19.448072 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:19.448040    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:19.562909 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:19.562880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:19.657315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:19.657252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:30.276466 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:30.276437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:30.697508 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:30.697486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:51.734065 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:51.734029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:57.976746 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:57.976689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:58.076566 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.076542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:58.419279 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.419254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:58.667704 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.667675    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:25:58.667975 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.667963    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:25:58.668020 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.667977    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:25:58.668054 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.668043    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:25:58.668054 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.668051    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:25:58.670149 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.670096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.672620 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.672585    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a2d232-openshift-default-dockercfg-tcr4x\""
Jul 14 16:25:58.676937 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.676914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:58.690386 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.690366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:25:58.718117 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcwg\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718237 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.718632 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.718467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819428 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819428 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcwg\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.819729 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.820118 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.819826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.820118 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.820045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.820234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.820127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.820475 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.820449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.820765 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.820742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.821880 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.821861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.821988 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.821972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.827953 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.827931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.828195 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.828173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcwg\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg\") pod \"e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") " pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:58.980494 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:58.980441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:25:59.092302 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.092266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:25:59.117982 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.117961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:25:59.119757 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:25:59.119732    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cc61b9_2cf6_458e_a9e7_baebe07bb726.slice/crio-135a1466dc41f52e8c264660443979539b349edddc4c8071c7f588f7f752c135 WatchSource:0}: Error finding container 135a1466dc41f52e8c264660443979539b349edddc4c8071c7f588f7f752c135: Status 404 returned error can't find the container with id 135a1466dc41f52e8c264660443979539b349edddc4c8071c7f588f7f752c135
Jul 14 16:25:59.121754 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.121721    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:25:59.121839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.121788    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:25:59.121839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.121815    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:25:59.790028 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.789998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerStarted","Data":"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"}
Jul 14 16:25:59.790200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.790042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerStarted","Data":"135a1466dc41f52e8c264660443979539b349edddc4c8071c7f588f7f752c135"}
Jul 14 16:25:59.812912 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.812866    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" podStartSLOduration=1.812851695 podStartE2EDuration="1.812851695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:25:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:25:59.810385104 +0000 UTC m=+2365.555781632" watchObservedRunningTime="2026-07-14 16:25:59.812851695 +0000 UTC m=+2365.558248219"
Jul 14 16:25:59.981096 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:25:59.981056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:00.985419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:00.985392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:01.168880 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.168854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:01.792724 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.792692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:01.800163 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.800139    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:01.800933 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.800916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:01.877370 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.877338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:01.952772 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:01.952744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:02.406614 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:02.406568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:02.508357 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:02.508333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:02.607126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:02.607097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:06.404904 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:06.404869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:06.729257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:06.729226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:07.153505 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.153433    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:26:07.153777 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.153764    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:26:07.153836 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.153779    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec5182d-aeda-4dc1-aae4-45b9c1bcd723" containerName="istio-proxy"
Jul 14 16:26:07.156057 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.156036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.158774 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.158755    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a4a505-openshift-default-dockercfg-thgvd\""
Jul 14 16:26:07.172485 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.172461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:26:07.172990 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.172969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:07.284057 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.284031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:07.286307 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286716 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286716 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjhr\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.286716 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.286577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387340 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjhr\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387828 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387828 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387828 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387990 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.387990 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.388093 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.387982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.388311 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.388284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.388403 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.388355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.389701 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.389681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.390015 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.389997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.397209 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.397166    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.398124 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.398098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjhr\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr\") pod \"e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") " pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.466914 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.466896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:07.605888 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.605863    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:26:07.607046 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:26:07.607013    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68a8b50_40f1_42f8_b2d2_3dfc9116f4a4.slice/crio-ef80bd71ffa2f9ee1a9b20b794dfd640ca93d3a70c082f24bd18db770192132b WatchSource:0}: Error finding container ef80bd71ffa2f9ee1a9b20b794dfd640ca93d3a70c082f24bd18db770192132b: Status 404 returned error can't find the container with id ef80bd71ffa2f9ee1a9b20b794dfd640ca93d3a70c082f24bd18db770192132b
Jul 14 16:26:07.609108 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.609078    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:07.609209 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.609139    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:07.609209 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.609165    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:07.830325 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.830214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerStarted","Data":"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"}
Jul 14 16:26:07.830325 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.830290    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerStarted","Data":"ef80bd71ffa2f9ee1a9b20b794dfd640ca93d3a70c082f24bd18db770192132b"}
Jul 14 16:26:07.851369 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:07.851320    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podStartSLOduration=0.85130198 podStartE2EDuration="851.30198ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:07.850462232 +0000 UTC m=+2373.595858759" watchObservedRunningTime="2026-07-14 16:26:07.85130198 +0000 UTC m=+2373.596698512"
Jul 14 16:26:08.467801 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:08.467771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:08.472205 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:08.472185    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:08.835525 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:08.835448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:08.836274 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:08.836255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:09.861635 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:09.861579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:09.948005 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:09.947976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:10.005312 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:10.005270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:26:10.022210 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:10.022181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:10.402057 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:10.402027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:10.609544 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:10.609503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:10.700917 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:10.700889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:14.429150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:14.429118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:20.908151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.908043    2564 generic.go:356] "Generic (PLEG): container finished" podID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerID="e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789" exitCode=0
Jul 14 16:26:20.908151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.908121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerDied","Data":"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"}
Jul 14 16:26:20.908788 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.908640    2564 scope.go:117] "RemoveContainer" containerID="e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"
Jul 14 16:26:20.909706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.909677    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:20.909781 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.909760    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:20.909869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:20.909810    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:21.536072 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:21.536032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:21.590303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:21.590267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:26:21.915510 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:21.915469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerStarted","Data":"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"}
Jul 14 16:26:21.981415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:21.981330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:22.981878 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:22.981838    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 14 16:26:22.982356 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:22.981910    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 14 16:26:23.202362 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:23.202258    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:23.300511 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:23.300406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:23.981961 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:23.981926    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 14 16:26:23.982382 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:23.981983    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 14 16:26:24.877797 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:24.877753    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 16:26:24.877994 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:24.877843    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 16:26:24.981738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:24.981700    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 14 16:26:24.981892 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:24.981759    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 14 16:26:25.938935 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.938901    2564 generic.go:356] "Generic (PLEG): container finished" podID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerID="42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252" exitCode=0
Jul 14 16:26:25.939346 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.938972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerDied","Data":"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"}
Jul 14 16:26:25.939389 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.939349    2564 scope.go:117] "RemoveContainer" containerID="42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"
Jul 14 16:26:25.940422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.940394    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:25.940490 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.940475    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:25.940536 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.940522    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:26:25.984914 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.984887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:25.985174 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.985155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:25.985824 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:25.985807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:26:26.946277 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:26.946239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerStarted","Data":"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"}
Jul 14 16:26:27.467540 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:27.467510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:27.467894 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:27.467556    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 14 16:26:27.468353 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:27.468062    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 14 16:26:28.467987 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:28.467941    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 14 16:26:28.468502 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:28.468012    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 14 16:26:29.467943 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:29.467902    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 14 16:26:29.468252 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:29.468219    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 14 16:26:30.468130 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:30.468081    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 14 16:26:30.468312 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:30.468160    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 14 16:26:31.471309 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.471277    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:31.471742 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.471548    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:31.472164 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.472150    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:26:31.499967 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.499941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:26:31.521993 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.521968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:31.616100 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:31.616063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:34.857508 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:34.857477    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:26:34.866863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:34.866842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:26:44.471009 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:44.470979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:26:44.571427 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:26:44.571396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:11.838134 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:11.838054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:12.068027 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:12.067990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:12.168363 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:12.168334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:15.608271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:15.608235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:27:16.292028 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:16.291996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:27.736129 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:27.736090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:33.839407 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:33.839376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:34.961413 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:34.961376    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"]
Jul 14 16:27:34.964979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:34.964940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:34.969294 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:34.969265    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 16:27:34.970493 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:34.970471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-62c9m\""
Jul 14 16:27:34.975911 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:34.975887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"]
Jul 14 16:27:35.039216 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:35.039182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp\" (UID: \"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:35.139871 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:35.139827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp\" (UID: \"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:35.140438 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:35.140417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp\" (UID: \"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:35.278365 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:35.278281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:35.427239 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:35.427215    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"]
Jul 14 16:27:35.428701 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:27:35.428674    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9168f845_e1c6_4da1_9ca9_2cbb678d0eaf.slice/crio-3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425 WatchSource:0}: Error finding container 3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425: Status 404 returned error can't find the container with id 3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425
Jul 14 16:27:36.112828 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:36.112669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:36.189104 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:36.189074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:36.322647 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:36.322583    2564 generic.go:356] "Generic (PLEG): container finished" podID="9168f845-e1c6-4da1-9ca9-2cbb678d0eaf" containerID="c81afc200c8c98ad2aaf39f42ff49195cccd877a7a085a5ae00323da3a4b4d71" exitCode=0
Jul 14 16:27:36.322833 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:36.322665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp" event={"ID":"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf","Type":"ContainerDied","Data":"c81afc200c8c98ad2aaf39f42ff49195cccd877a7a085a5ae00323da3a4b4d71"}
Jul 14 16:27:36.322833 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:36.322716    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp" event={"ID":"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf","Type":"ContainerStarted","Data":"3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425"}
Jul 14 16:27:37.382211 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:37.382137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:37.462128 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:37.462110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:37.558084 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:37.558059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca\") pod \"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf\" (UID: \"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf\") "
Jul 14 16:27:37.558397 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:37.558376    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9168f845-e1c6-4da1-9ca9-2cbb678d0eaf" (UID: "9168f845-e1c6-4da1-9ca9-2cbb678d0eaf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:27:37.659271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:37.659217    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9168f845-e1c6-4da1-9ca9-2cbb678d0eaf-maas-api-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:27:38.335464 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:38.335420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp" event={"ID":"9168f845-e1c6-4da1-9ca9-2cbb678d0eaf","Type":"ContainerDied","Data":"3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425"}
Jul 14 16:27:38.335661 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:38.335481    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d9973cbe3cae1c98f6df32843b82d4d8ed68b55978f7ca82be75561caf4b425"
Jul 14 16:27:38.335661 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:38.335432    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp"
Jul 14 16:27:39.694377 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:39.694344    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:27:45.704135 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:45.704106    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:50.067669 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:50.067585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:51.590014 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:51.589980    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:27:56.508122 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:56.508092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:27:56.607565 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:27:56.607501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:00.879927 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:00.879891    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:28:00.880426 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:00.880081    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy" containerID="cri-o://dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4" gracePeriod=30
Jul 14 16:28:00.892883 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:00.892855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:01.134550 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:01.134470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:01.857352 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:01.857321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:01.957403 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:01.957372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:06.130299 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.130272    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:28:06.287997 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.287976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288078    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288095    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288167    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmcwg\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288200    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288238 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288240    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket\") pod \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\" (UID: \"42cc61b9-2cf6-458e-a9e7-baebe07bb726\") "
Jul 14 16:28:06.288706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288487    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:06.288706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:06.288706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288508    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:06.288706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.288666    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:06.289423 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.289397    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data" (OuterVolumeSpecName: "istio-data") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:06.290330 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.290309    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:06.290414 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.290387    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token" (OuterVolumeSpecName: "istio-token") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:06.291109 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.291083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:28:06.291109 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.291086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg" (OuterVolumeSpecName: "kube-api-access-xmcwg") pod "42cc61b9-2cf6-458e-a9e7-baebe07bb726" (UID: "42cc61b9-2cf6-458e-a9e7-baebe07bb726"). InnerVolumeSpecName "kube-api-access-xmcwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:06.389737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389709    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389728    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389737    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389748    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmcwg\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-kube-api-access-xmcwg\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389758    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389767    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389775    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389783    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42cc61b9-2cf6-458e-a9e7-baebe07bb726-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.389891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.389790    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42cc61b9-2cf6-458e-a9e7-baebe07bb726-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:06.495522 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.495491    2564 generic.go:356] "Generic (PLEG): container finished" podID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerID="dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4" exitCode=0
Jul 14 16:28:06.495656 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.495547    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"
Jul 14 16:28:06.495656 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.495579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerDied","Data":"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"}
Jul 14 16:28:06.495656 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.495655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962" event={"ID":"42cc61b9-2cf6-458e-a9e7-baebe07bb726","Type":"ContainerDied","Data":"135a1466dc41f52e8c264660443979539b349edddc4c8071c7f588f7f752c135"}
Jul 14 16:28:06.495822 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.495683    2564 scope.go:117] "RemoveContainer" containerID="dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"
Jul 14 16:28:06.504975 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.504960    2564 scope.go:117] "RemoveContainer" containerID="e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"
Jul 14 16:28:06.513125 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.513111    2564 scope.go:117] "RemoveContainer" containerID="dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"
Jul 14 16:28:06.513370 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:28:06.513354    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4\": container with ID starting with dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4 not found: ID does not exist" containerID="dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"
Jul 14 16:28:06.513415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.513375    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4"} err="failed to get container status \"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4\": rpc error: code = NotFound desc = could not find container \"dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4\": container with ID starting with dd57bf6ca7c1603f19f5b16eeba4ce141af1b578566ec8d20985326901b836a4 not found: ID does not exist"
Jul 14 16:28:06.513415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.513391    2564 scope.go:117] "RemoveContainer" containerID="e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"
Jul 14 16:28:06.513644 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:28:06.513625    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789\": container with ID starting with e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789 not found: ID does not exist" containerID="e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"
Jul 14 16:28:06.513706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.513647    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789"} err="failed to get container status \"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789\": rpc error: code = NotFound desc = could not find container \"e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789\": container with ID starting with e7b1268a9184c98b916f446f2e8f70470224a6652cde6440a7957b93eb5de789 not found: ID does not exist"
Jul 14 16:28:06.518068 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.518043    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:28:06.521539 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.521519    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a2d232-openshift-default-6558d8c9d9-7h962"]
Jul 14 16:28:06.769341 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:06.769316    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" path="/var/lib/kubelet/pods/42cc61b9-2cf6-458e-a9e7-baebe07bb726/volumes"
Jul 14 16:28:11.733065 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:11.733026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:14.901224 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:14.901180    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:28:16.335429 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:16.335374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:22.578995 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:22.578935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:22.677995 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:22.677960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:27.053392 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:27.053356    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:28:27.053926 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:27.053630    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" containerID="cri-o://e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c" gracePeriod=30
Jul 14 16:28:27.071841 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:27.071814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:27.388110 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:27.387998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:27.781743 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:27.781704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:28.056102 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056032    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056340    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056350    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056361    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056367    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056388    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9168f845-e1c6-4da1-9ca9-2cbb678d0eaf" containerName="revoke-keys"
Jul 14 16:28:28.056437 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056395    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9168f845-e1c6-4da1-9ca9-2cbb678d0eaf" containerName="revoke-keys"
Jul 14 16:28:28.056646 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056447    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9168f845-e1c6-4da1-9ca9-2cbb678d0eaf" containerName="revoke-keys"
Jul 14 16:28:28.056646 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056458    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.056646 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.056465    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="42cc61b9-2cf6-458e-a9e7-baebe07bb726" containerName="istio-proxy"
Jul 14 16:28:28.058537 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.058521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.061259 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.061236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d7e901-openshift-default-dockercfg-gfw6t\""
Jul 14 16:28:28.070843 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.070815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:28:28.077488 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.077463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:28.169980 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.169946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170150 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvvj\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170257 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.170391 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.170268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.205367 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.205339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:28.271285 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271285 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvvj\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.271623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.272017 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.272017 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.272017 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.272017 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.271975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.272415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.272222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.273847 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.273825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.274067 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.274045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.281000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.280975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvvj\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.281114 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.281081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token\") pod \"e2e-api-a-d7e901-openshift-default-6649d5b76c-54664\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") " pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.368997 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.368918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:28.511782 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.511756    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:28:28.513531 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:28:28.513507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9851199b_956a_4e15_b2c2_8264d6b8172d.slice/crio-23d05f5d1bda09ea03d0817b0a8a2bf356ba4a133f91914a87798b61e850cf04 WatchSource:0}: Error finding container 23d05f5d1bda09ea03d0817b0a8a2bf356ba4a133f91914a87798b61e850cf04: Status 404 returned error can't find the container with id 23d05f5d1bda09ea03d0817b0a8a2bf356ba4a133f91914a87798b61e850cf04
Jul 14 16:28:28.515747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.515717    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:28.515810 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.515797    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:28.515855 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.515826    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:28.620175 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.620074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerStarted","Data":"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"}
Jul 14 16:28:28.620175 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.620141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerStarted","Data":"23d05f5d1bda09ea03d0817b0a8a2bf356ba4a133f91914a87798b61e850cf04"}
Jul 14 16:28:28.643506 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:28.643448    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podStartSLOduration=0.643427683 podStartE2EDuration="643.427683ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:28:28.640421034 +0000 UTC m=+2514.385817562" watchObservedRunningTime="2026-07-14 16:28:28.643427683 +0000 UTC m=+2514.388824211"
Jul 14 16:28:29.369805 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:29.369776    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:29.374480 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:29.374454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:29.625273 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:29.625180    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:29.626246 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:29.626227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:31.028721 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.028688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:31.129248 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.129214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:31.228753 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.228698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:31.474342 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.474308    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:28:31.474512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.474360    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:28:31.477281 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.477254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:31.577897 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:31.577863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:32.317851 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.317787    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:28:32.406529 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406741 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406623    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406741 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckjhr\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406741 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406741 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406734    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406972 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406779    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406972 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406972 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.406972 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert\") pod \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\" (UID: \"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4\") "
Jul 14 16:28:32.407162 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.406999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:32.407162 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407024    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:32.407162 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:32.407363 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407271    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.407448 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407433    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.407501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407452    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.407501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:32.407501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.407333    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:32.408936 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.408913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:32.409279 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.409254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:28:32.409520 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.409501    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr" (OuterVolumeSpecName: "kube-api-access-ckjhr") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "kube-api-access-ckjhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:32.409572 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.409502    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" (UID: "c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:32.508262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508227    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.508262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508258    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.508262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508267    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.508501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508275    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.508501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508285    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.508501 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.508293    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckjhr\" (UniqueName: \"kubernetes.io/projected/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4-kube-api-access-ckjhr\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:28:32.643528 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.643440    2564 generic.go:356] "Generic (PLEG): container finished" podID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerID="e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c" exitCode=0
Jul 14 16:28:32.643528 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.643492    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"
Jul 14 16:28:32.643742 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.643540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerDied","Data":"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"}
Jul 14 16:28:32.643742 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.643625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz" event={"ID":"c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4","Type":"ContainerDied","Data":"ef80bd71ffa2f9ee1a9b20b794dfd640ca93d3a70c082f24bd18db770192132b"}
Jul 14 16:28:32.643742 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.643651    2564 scope.go:117] "RemoveContainer" containerID="e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"
Jul 14 16:28:32.653463 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.653441    2564 scope.go:117] "RemoveContainer" containerID="42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"
Jul 14 16:28:32.662155 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.662134    2564 scope.go:117] "RemoveContainer" containerID="e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"
Jul 14 16:28:32.662442 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:28:32.662423    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c\": container with ID starting with e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c not found: ID does not exist" containerID="e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"
Jul 14 16:28:32.662513 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.662450    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c"} err="failed to get container status \"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c\": rpc error: code = NotFound desc = could not find container \"e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c\": container with ID starting with e2d5f804dd39d988cc6ea36527bd6af0fbed1dd1730cbd35c286b23daf73b65c not found: ID does not exist"
Jul 14 16:28:32.662513 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.662466    2564 scope.go:117] "RemoveContainer" containerID="42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"
Jul 14 16:28:32.662701 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:28:32.662683    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252\": container with ID starting with 42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252 not found: ID does not exist" containerID="42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"
Jul 14 16:28:32.662740 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.662708    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252"} err="failed to get container status \"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252\": rpc error: code = NotFound desc = could not find container \"42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252\": container with ID starting with 42cf5639ffc1ad3558cfc06c31b8a7a046ee2ebe04f73dca2ccd7dee96281252 not found: ID does not exist"
Jul 14 16:28:32.671902 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.671855    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:28:32.673780 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.673758    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a4a505-openshift-default-5494499f47-fdvhz"]
Jul 14 16:28:32.770163 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:32.770118    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" path="/var/lib/kubelet/pods/c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4/volumes"
Jul 14 16:28:35.224940 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.224909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:35.670847 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.670775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:35.902611 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.902555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:28:35.992349 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992264    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:28:35.992610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992582    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:28:35.992659 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992616    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:28:35.992659 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992648    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:28:35.992659 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992657    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:28:35.992803 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.992738    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:28:35.996283 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.996263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:35.998993 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:35.998972    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c40588-openshift-default-dockercfg-js7gw\""
Jul 14 16:28:36.009247 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.009222    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:28:36.021946 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.021922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:36.035862 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.035827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.035868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.035901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.035927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.035969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.036002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.036027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjfgn\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036341 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.036054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.036341 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.036128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.120708 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.120673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:36.136923 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.136890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.136939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.136983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137029 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjfgn\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137455 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137708 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137798 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137798 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.137952 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.137929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.139697 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.139675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.139697 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.139692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.145484 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.145463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.145801 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.145781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjfgn\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn\") pod \"e2e-api-b-c40588-openshift-default-667789f48f-vs8xz\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") " pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.307042 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.306942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:36.461167 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.461138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:28:36.462882 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:28:36.462852    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974fb11c_44aa_4879_a4b6_69480419e155.slice/crio-9679547ef13d9959113fbbbec79efce7ae51cae6d3bdac8ffe0cd6f4187c2b93 WatchSource:0}: Error finding container 9679547ef13d9959113fbbbec79efce7ae51cae6d3bdac8ffe0cd6f4187c2b93: Status 404 returned error can't find the container with id 9679547ef13d9959113fbbbec79efce7ae51cae6d3bdac8ffe0cd6f4187c2b93
Jul 14 16:28:36.465024 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.464995    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:36.465110 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.465059    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:36.465110 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.465090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:36.669813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.669774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerStarted","Data":"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"}
Jul 14 16:28:36.669999 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.669842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerStarted","Data":"9679547ef13d9959113fbbbec79efce7ae51cae6d3bdac8ffe0cd6f4187c2b93"}
Jul 14 16:28:36.691232 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:36.691177    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podStartSLOduration=1.6911593200000001 podStartE2EDuration="1.69115932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:28:36.689797421 +0000 UTC m=+2522.435193950" watchObservedRunningTime="2026-07-14 16:28:36.69115932 +0000 UTC m=+2522.436555846"
Jul 14 16:28:37.307194 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:37.307157    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:37.313011 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:37.312984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:37.676606 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:37.676560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:37.677716 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:37.677694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:38.919586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:38.919552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:39.034692 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:39.034657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:39.425109 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:39.425084    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:39.525308 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:39.525273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:43.220378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:43.220325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:44.496434 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.496393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:28:44.626891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.626853    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 14 16:28:44.627057 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.626920    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 14 16:28:44.714881 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.714847    2564 generic.go:356] "Generic (PLEG): container finished" podID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerID="c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f" exitCode=0
Jul 14 16:28:44.715051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.714924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerDied","Data":"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"}
Jul 14 16:28:44.715340 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.715326    2564 scope.go:117] "RemoveContainer" containerID="c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"
Jul 14 16:28:44.716399 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.716373    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:44.716502 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.716438    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:44.716502 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:44.716470    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:45.722739 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:45.722707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerStarted","Data":"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"}
Jul 14 16:28:46.370232 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:46.370186    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:46.370511 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:46.370335    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 14 16:28:46.370511 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:46.370399    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 14 16:28:47.369866 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:47.369822    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 14 16:28:47.370468 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:47.370421    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 14 16:28:48.369920 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:48.369872    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 14 16:28:48.370419 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:48.369941    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 14 16:28:49.370476 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:49.370432    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 14 16:28:49.371122 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:49.371085    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 14 16:28:50.373721 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:50.373690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:50.374190 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:50.374036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:50.374807 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:50.374787    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:28:52.129740 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.129704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:52.231318 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.231282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:28:52.678692 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.678664    2564 patch_prober.go:28] interesting pod/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:28:52.678836 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.678754    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 14 16:28:52.762418 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.762382    2564 generic.go:356] "Generic (PLEG): container finished" podID="974fb11c-44aa-4879-a4b6-69480419e155" containerID="55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787" exitCode=0
Jul 14 16:28:52.762526 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.762457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerDied","Data":"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"}
Jul 14 16:28:52.762898 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.762883    2564 scope.go:117] "RemoveContainer" containerID="55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"
Jul 14 16:28:52.763923 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.763895    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:52.764004 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.763968    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:52.764066 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:52.764005    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:28:53.775165 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:53.775130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerStarted","Data":"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"}
Jul 14 16:28:54.308000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:54.307967    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:54.308213 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:54.308190    2564 patch_prober.go:28] interesting pod/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:28:54.308265 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:54.308241    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 14 16:28:55.307947 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:55.307907    2564 patch_prober.go:28] interesting pod/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:28:55.308422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:55.307976    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 14 16:28:56.307822 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:56.307783    2564 patch_prober.go:28] interesting pod/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:28:56.307983 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:56.307838    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 14 16:28:57.310803 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:57.310771    2564 patch_prober.go:28] interesting pod/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 14 16:28:57.311216 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:57.311177    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 14 16:28:58.311757 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:58.311724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:58.312287 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:58.312260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:28:58.313037 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:28:58.313017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:29:00.218261 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:00.218225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:00.321928 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:00.321889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:02.157757 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:02.157726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:02.257791 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:02.257758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:02.494569 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:02.494537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:05.900128 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:05.900081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:29:06.708066 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:06.708035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:13.310579 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:13.310547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:13.411917 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:13.411885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:17.424055 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:17.424017    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:29:17.424480 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:17.424232    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" containerID="cri-o://4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0" gracePeriod=30
Jul 14 16:29:17.464421 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:17.464394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:17.660881 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:17.660849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:18.422773 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:18.422742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:18.524496 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:18.524467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:20.376452 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:20.376413    2564 patch_prober.go:28] interesting pod/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:29:20.376948 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:20.376476    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:29:22.678528 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.678504    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:29:22.840335 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840263    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840335 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840391    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kvvj\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840543 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:22.840839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840556    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket\") pod \"9851199b-956a-4e15-b2c2-8264d6b8172d\" (UID: \"9851199b-956a-4e15-b2c2-8264d6b8172d\") "
Jul 14 16:29:22.840839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:29:22.841051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.840924    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:22.841051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.841006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:22.841051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.841045    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.841378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.841063    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9851199b-956a-4e15-b2c2-8264d6b8172d-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.841378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.841075    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.841378 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.841270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:22.842870 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.842842    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj" (OuterVolumeSpecName: "kube-api-access-6kvvj") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "kube-api-access-6kvvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:29:22.843006 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.842953    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:29:22.843242 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.843217    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:29:22.843335 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.843247    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9851199b-956a-4e15-b2c2-8264d6b8172d" (UID: "9851199b-956a-4e15-b2c2-8264d6b8172d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:22.928532 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.928508    2564 generic.go:356] "Generic (PLEG): container finished" podID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerID="4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0" exitCode=0
Jul 14 16:29:22.928665 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.928563    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"
Jul 14 16:29:22.928665 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.928625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerDied","Data":"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"}
Jul 14 16:29:22.928762 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.928680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664" event={"ID":"9851199b-956a-4e15-b2c2-8264d6b8172d","Type":"ContainerDied","Data":"23d05f5d1bda09ea03d0817b0a8a2bf356ba4a133f91914a87798b61e850cf04"}
Jul 14 16:29:22.928762 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.928710    2564 scope.go:117] "RemoveContainer" containerID="4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"
Jul 14 16:29:22.937971 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.937955    2564 scope.go:117] "RemoveContainer" containerID="c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"
Jul 14 16:29:22.942387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942368    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.942387 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942386    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.942523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942394    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.942523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942402    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kvvj\" (UniqueName: \"kubernetes.io/projected/9851199b-956a-4e15-b2c2-8264d6b8172d-kube-api-access-6kvvj\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.942523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942412    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9851199b-956a-4e15-b2c2-8264d6b8172d-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.942523 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.942420    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9851199b-956a-4e15-b2c2-8264d6b8172d-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:22.945956 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.945940    2564 scope.go:117] "RemoveContainer" containerID="4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"
Jul 14 16:29:22.946214 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:29:22.946197    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0\": container with ID starting with 4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0 not found: ID does not exist" containerID="4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"
Jul 14 16:29:22.946255 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.946221    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0"} err="failed to get container status \"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0\": rpc error: code = NotFound desc = could not find container \"4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0\": container with ID starting with 4ef3013d3ec1dd1743ea2db60f530f9baae3fcf3bc45fd35b51d081ccca9aef0 not found: ID does not exist"
Jul 14 16:29:22.946255 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.946237    2564 scope.go:117] "RemoveContainer" containerID="c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"
Jul 14 16:29:22.946467 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:29:22.946451    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f\": container with ID starting with c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f not found: ID does not exist" containerID="c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"
Jul 14 16:29:22.946513 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.946474    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f"} err="failed to get container status \"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f\": rpc error: code = NotFound desc = could not find container \"c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f\": container with ID starting with c12dd3cdd416ed8e509050782d0cdea4e928da8e05351b65b955502543affb1f not found: ID does not exist"
Jul 14 16:29:22.951124 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.951102    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:29:22.956824 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:22.956804    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d7e901-openshift-default-6649d5b76c-54664"]
Jul 14 16:29:24.769917 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:24.769882    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" path="/var/lib/kubelet/pods/9851199b-956a-4e15-b2c2-8264d6b8172d/volumes"
Jul 14 16:29:28.336747 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:28.336692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:31.301456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:31.301415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:29:32.927366 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:32.927326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:39.206883 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:39.206848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:39.307953 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:39.307921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:43.729236 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:43.729201    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:29:43.729692 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:43.729443    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy" containerID="cri-o://56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0" gracePeriod=30
Jul 14 16:29:43.751614 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:43.747021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:43.979135 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:43.979104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:44.356012 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.355973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:44.710264 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710238    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:29:44.710649 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710633    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:44.710701 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710651    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:44.710738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710719    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:44.710738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710726    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:44.710738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.710732    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c68a8b50-40f1-42f8-b2d2-3dfc9116f4a4" containerName="istio-proxy"
Jul 14 16:29:44.713023 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.713007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.717537 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.717517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-21b35e-openshift-default-dockercfg-lsgdq\""
Jul 14 16:29:44.737796 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.737768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:29:44.744265 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.744229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:44.874539 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.874508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:44.906431 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906556 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906556 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5xvm\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906556 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906719 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:44.906857 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:44.906724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007777 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007777 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5xvm\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.007962 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.007901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008222 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008222 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008505 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008505 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.008706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.008585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.010331 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.010298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.010847 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.010827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.017231 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.017202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.017526 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.017505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5xvm\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm\") pod \"e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") " pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.023269 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.023243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:45.167439 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.167409    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:29:45.168307 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:29:45.168282    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01077b36_f053_40e2_9db0_ea470795dac9.slice/crio-a3741024c63368ef8a5deffcb5099cec6f82aed5dc4c5bf0fcc2180e34b70d21 WatchSource:0}: Error finding container a3741024c63368ef8a5deffcb5099cec6f82aed5dc4c5bf0fcc2180e34b70d21: Status 404 returned error can't find the container with id a3741024c63368ef8a5deffcb5099cec6f82aed5dc4c5bf0fcc2180e34b70d21
Jul 14 16:29:45.170580 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.170548    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:45.170678 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.170636    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:45.170718 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:45.170679    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:46.055607 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:46.055554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerStarted","Data":"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"}
Jul 14 16:29:46.055988 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:46.055625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerStarted","Data":"a3741024c63368ef8a5deffcb5099cec6f82aed5dc4c5bf0fcc2180e34b70d21"}
Jul 14 16:29:46.079664 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:46.079586    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podStartSLOduration=2.079566159 podStartE2EDuration="2.079566159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:29:46.078405862 +0000 UTC m=+2591.823802389" watchObservedRunningTime="2026-07-14 16:29:46.079566159 +0000 UTC m=+2591.824962686"
Jul 14 16:29:47.023817 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:47.023785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:47.029060 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:47.029036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:47.069675 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:47.069646    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:47.070560 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:47.070538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:29:48.082172 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.082140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.169186 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.169153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.262059 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.262031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.372230 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.372139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.790063 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.790036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.893087 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.893055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:48.973976 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:48.973955    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:29:49.035623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035531    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035623 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjfgn\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035668    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert\") pod \"974fb11c-44aa-4879-a4b6-69480419e155\" (UID: \"974fb11c-44aa-4879-a4b6-69480419e155\") "
Jul 14 16:29:49.035863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:49.036193 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.035977    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:49.036193 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.036157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:29:49.036193 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.036161    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.036353 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.036205    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.036353 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.036266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:49.036968 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.036941    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data" (OuterVolumeSpecName: "istio-data") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:49.037937 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.037915    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn" (OuterVolumeSpecName: "kube-api-access-zjfgn") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "kube-api-access-zjfgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:29:49.038033 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.037985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:29:49.038075 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.038064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token" (OuterVolumeSpecName: "istio-token") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:29:49.038160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.038146    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "974fb11c-44aa-4879-a4b6-69480419e155" (UID: "974fb11c-44aa-4879-a4b6-69480419e155"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:29:49.080642 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.080584    2564 generic.go:356] "Generic (PLEG): container finished" podID="974fb11c-44aa-4879-a4b6-69480419e155" containerID="56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0" exitCode=0
Jul 14 16:29:49.080738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.080660    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"
Jul 14 16:29:49.080738 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.080627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerDied","Data":"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"}
Jul 14 16:29:49.080827 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.080743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz" event={"ID":"974fb11c-44aa-4879-a4b6-69480419e155","Type":"ContainerDied","Data":"9679547ef13d9959113fbbbec79efce7ae51cae6d3bdac8ffe0cd6f4187c2b93"}
Jul 14 16:29:49.080827 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.080767    2564 scope.go:117] "RemoveContainer" containerID="56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"
Jul 14 16:29:49.090331 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.090314    2564 scope.go:117] "RemoveContainer" containerID="55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"
Jul 14 16:29:49.098134 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.098118    2564 scope.go:117] "RemoveContainer" containerID="56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"
Jul 14 16:29:49.098376 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:29:49.098358    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0\": container with ID starting with 56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0 not found: ID does not exist" containerID="56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"
Jul 14 16:29:49.098427 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.098385    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0"} err="failed to get container status \"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0\": rpc error: code = NotFound desc = could not find container \"56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0\": container with ID starting with 56c29f86c3f758562c581043b2fbebbfb8c1b910b130b17573b28984ec20d3e0 not found: ID does not exist"
Jul 14 16:29:49.098427 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.098401    2564 scope.go:117] "RemoveContainer" containerID="55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"
Jul 14 16:29:49.098675 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:29:49.098653    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787\": container with ID starting with 55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787 not found: ID does not exist" containerID="55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"
Jul 14 16:29:49.098723 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.098688    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787"} err="failed to get container status \"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787\": rpc error: code = NotFound desc = could not find container \"55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787\": container with ID starting with 55025cd15badb91c852746c0352390d0f86c595213fc2dd94c1f5be3e8aab787 not found: ID does not exist"
Jul 14 16:29:49.114073 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.114048    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:29:49.119831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.119813    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c40588-openshift-default-667789f48f-vs8xz"]
Jul 14 16:29:49.137023 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.136997    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjfgn\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-kube-api-access-zjfgn\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137023 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137022    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137176 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137036    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fb11c-44aa-4879-a4b6-69480419e155-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137176 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137049    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137176 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137061    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fb11c-44aa-4879-a4b6-69480419e155-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137176 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137074    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fb11c-44aa-4879-a4b6-69480419e155-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.137176 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.137087    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fb11c-44aa-4879-a4b6-69480419e155-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:29:49.777185 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:49.777151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:50.768887 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:50.768858    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="974fb11c-44aa-4879-a4b6-69480419e155" path="/var/lib/kubelet/pods/974fb11c-44aa-4879-a4b6-69480419e155/volumes"
Jul 14 16:29:52.204542 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:52.204510    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:29:52.610958 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:52.610877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:53.025460 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.025429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:53.361675 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.357372    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373111    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373150    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373171    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373179    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373192    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373200    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9851199b-956a-4e15-b2c2-8264d6b8172d" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.373979 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.373306    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="974fb11c-44aa-4879-a4b6-69480419e155" containerName="istio-proxy"
Jul 14 16:29:53.376875 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.376849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.377131 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.377107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:29:53.380181 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.380160    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4e27c0-openshift-default-dockercfg-nwgj4\""
Jul 14 16:29:53.385126 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.385103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:53.574511 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkgb\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574938 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574938 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.574938 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.574867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.675734 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.675734 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkgb\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.675923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676365 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.676087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676365 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.676222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676365 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.676295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.676486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.676530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.676488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.678379 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.678336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.678498 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.678481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.689321 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.689292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkgb\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.703160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.703133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token\") pod \"e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") " pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:53.817200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.817169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:53.988502 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:53.988409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:54.147561 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:54.147539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:29:54.173542 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:29:54.173514    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d728de_b086_464c_b54b_e055adc54fef.slice/crio-7ce6bc8ef24c88930c5333768e172fc7139f4e194e48dfc1e603e839d2be9c46 WatchSource:0}: Error finding container 7ce6bc8ef24c88930c5333768e172fc7139f4e194e48dfc1e603e839d2be9c46: Status 404 returned error can't find the container with id 7ce6bc8ef24c88930c5333768e172fc7139f4e194e48dfc1e603e839d2be9c46
Jul 14 16:29:54.175684 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:54.175656    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:54.175758 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:54.175716    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:54.175758 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:54.175744    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:29:55.116845 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:55.116812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerStarted","Data":"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"}
Jul 14 16:29:55.117211 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:55.116861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerStarted","Data":"7ce6bc8ef24c88930c5333768e172fc7139f4e194e48dfc1e603e839d2be9c46"}
Jul 14 16:29:55.147781 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:55.147723    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podStartSLOduration=2.147703828 podStartE2EDuration="2.147703828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:29:55.143851061 +0000 UTC m=+2600.889247586" watchObservedRunningTime="2026-07-14 16:29:55.147703828 +0000 UTC m=+2600.893100334"
Jul 14 16:29:55.989049 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:55.988967    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:55.994383 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:55.994338    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:56.122560 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:56.122536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:56.123481 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:56.123464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:29:57.206086 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:57.206048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:57.309831 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:57.309756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:57.392976 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:57.392949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:57.497294 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:57.497213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:57.993669 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:57.993626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:29:58.095092 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:29:58.095055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:00.144500 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.144475    2564 generic.go:356] "Generic (PLEG): container finished" podID="01077b36-f053-40e2-9db0-ea470795dac9" containerID="af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234" exitCode=0
Jul 14 16:30:00.144863 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.144523    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerDied","Data":"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"}
Jul 14 16:30:00.144939 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.144920    2564 scope.go:117] "RemoveContainer" containerID="af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"
Jul 14 16:30:00.145934 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.145909    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:00.146001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.145976    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:00.146046 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:00.146015    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:01.151117 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:01.151085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerStarted","Data":"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"}
Jul 14 16:30:01.791319 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:01.791291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:02.023912 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:02.023871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:30:02.025151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:02.025115    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 14 16:30:02.025301 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:02.025196    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 14 16:30:02.069913 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:02.069764    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:30:03.024388 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:03.024350    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 14 16:30:03.024904 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:03.024412    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 14 16:30:04.024346 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:04.024312    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 14 16:30:04.024508 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:04.024363    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 14 16:30:04.906108 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:04.906071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:30:05.023798 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:05.023761    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 14 16:30:05.023978 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:05.023815    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 14 16:30:06.024382 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:06.024349    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 14 16:30:06.024806 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:06.024405    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 14 16:30:07.028106 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:07.028079    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:30:07.028972 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:07.028951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:30:09.656642 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:09.656578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:11.884040 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:11.884011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:12.163713 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:12.163682    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 16:30:12.163865 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:12.163741    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 16:30:13.227914 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.227889    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0d728de-b086-464c-b54b-e055adc54fef" containerID="235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c" exitCode=0
Jul 14 16:30:13.228303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.227965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerDied","Data":"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"}
Jul 14 16:30:13.228303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.228277    2564 scope.go:117] "RemoveContainer" containerID="235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"
Jul 14 16:30:13.229178 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.229153    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:13.229245 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.229222    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:13.229284 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:13.229256    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 16:30:14.234391 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:14.234358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerStarted","Data":"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"}
Jul 14 16:30:14.988610 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:14.988556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:30:14.988855 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:14.988827    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:30:14.988916 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:14.988891    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 14 16:30:15.146262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:15.146230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:15.989073 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:15.989034    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:30:15.989472 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:15.989103    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 14 16:30:16.989153 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:16.989118    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:30:16.989555 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:16.989180    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 14 16:30:17.989106 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:17.989066    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 14 16:30:17.989291 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:17.989126    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 14 16:30:18.792868 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:18.792831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:30:18.835604 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:18.835568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:18.939852 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:18.939830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:19.043241 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:19.043143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:30:19.043869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:19.043833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:30:19.045032 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:19.045007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:30:33.628211 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:33.628181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:35.903498 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:35.903458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:30:37.898027 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:37.897994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:30:53.611112 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:30:53.611078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:31:12.717767 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:12.717732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:31:27.927133 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:27.927103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:31:34.890709 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:34.890680    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:31:34.900725 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:34.900700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:31:45.482999 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:45.482971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:45.584326 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:45.584280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:31:46.941060 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:46.941021    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:31:53.576054 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:31:53.576021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:02.298215 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:02.298182    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:32:21.296438 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:21.296400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:32:40.489415 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:40.489373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:32:45.031092 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:45.031055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:45.819016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:45.818983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:58.490887 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:58.490772    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:32:58.788713 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:58.788568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:32:58.885315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:32:58.885284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:11.599711 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:11.599670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:33:20.411915 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:20.411869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:20.509481 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:20.509446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:28.540197 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:28.540162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:33:33.189587 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:33.189537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:33:50.194315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:33:50.194277    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:34:08.125534 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:34:08.125500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:09.324586 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:34:09.324549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:11.602842 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:34:11.602812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:34:26.540312 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:34:26.540229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:34:30.822916 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:34:30.822872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:35:01.937037 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:01.936954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:06.796550 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:06.796506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:35:10.498657 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:10.498620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:10.595349 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:10.595323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:19.796556 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:19.796526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:22.710518 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:22.710490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:23.095283 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:23.095198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:35:28.186565 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:28.186532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:28.257249 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:28.257224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:45.207795 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:45.207755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:35:49.499314 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:49.499280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:51.462158 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.462128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:35:51.507840 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.507810    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7422-139946483124528"]
Jul 14 16:35:51.510400 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.510382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:51.513849 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.513829    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-bzk99\""
Jul 14 16:35:51.520517 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.520498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946483124528"]
Jul 14 16:35:51.562490 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.562465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj24z\" (UniqueName: \"kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z\") pod \"test-curl-7422-139946483124528\" (UID: \"e5e17688-825a-4a58-b8c9-add3167b546a\") " pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:51.663154 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.663129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj24z\" (UniqueName: \"kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z\") pod \"test-curl-7422-139946483124528\" (UID: \"e5e17688-825a-4a58-b8c9-add3167b546a\") " pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:51.675288 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.675263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj24z\" (UniqueName: \"kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z\") pod \"test-curl-7422-139946483124528\" (UID: \"e5e17688-825a-4a58-b8c9-add3167b546a\") " pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:51.818996 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.818948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:51.985225 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.985195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946483124528"]
Jul 14 16:35:51.988347 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:35:51.988322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5e17688_825a_4a58_b8c9_add3167b546a.slice/crio-a5e2240d35b1e260e3e7da037236671d3f448bd6602c7687c4ee3ffdeb5f908c WatchSource:0}: Error finding container a5e2240d35b1e260e3e7da037236671d3f448bd6602c7687c4ee3ffdeb5f908c: Status 404 returned error can't find the container with id a5e2240d35b1e260e3e7da037236671d3f448bd6602c7687c4ee3ffdeb5f908c
Jul 14 16:35:51.989887 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:51.989865    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:35:52.998517 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:52.998460    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5e17688-825a-4a58-b8c9-add3167b546a" containerID="0c696610d22fe98f02839d56ce37b314962d647a5d4784c8ce62e050423b9035" exitCode=0
Jul 14 16:35:52.998517 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:52.998506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946483124528" event={"ID":"e5e17688-825a-4a58-b8c9-add3167b546a","Type":"ContainerDied","Data":"0c696610d22fe98f02839d56ce37b314962d647a5d4784c8ce62e050423b9035"}
Jul 14 16:35:52.998880 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:52.998539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946483124528" event={"ID":"e5e17688-825a-4a58-b8c9-add3167b546a","Type":"ContainerStarted","Data":"a5e2240d35b1e260e3e7da037236671d3f448bd6602c7687c4ee3ffdeb5f908c"}
Jul 14 16:35:54.134666 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.134645    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:54.173093 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.173068    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7422-139946483124528_e5e17688-825a-4a58-b8c9-add3167b546a/test-curl-7422-139946483124528/0.log"
Jul 14 16:35:54.180271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.180252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj24z\" (UniqueName: \"kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z\") pod \"e5e17688-825a-4a58-b8c9-add3167b546a\" (UID: \"e5e17688-825a-4a58-b8c9-add3167b546a\") "
Jul 14 16:35:54.182442 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.182413    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z" (OuterVolumeSpecName: "kube-api-access-qj24z") pod "e5e17688-825a-4a58-b8c9-add3167b546a" (UID: "e5e17688-825a-4a58-b8c9-add3167b546a"). InnerVolumeSpecName "kube-api-access-qj24z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:35:54.224468 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.224448    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7422-139946483124528"]
Jul 14 16:35:54.229141 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.229119    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7422-139946483124528"]
Jul 14 16:35:54.281408 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.281356    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj24z\" (UniqueName: \"kubernetes.io/projected/e5e17688-825a-4a58-b8c9-add3167b546a-kube-api-access-qj24z\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:35:54.364439 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.364418    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7422-139946477401136"]
Jul 14 16:35:54.364767 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.364754    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e17688-825a-4a58-b8c9-add3167b546a" containerName="test-curl-7422-139946483124528"
Jul 14 16:35:54.364814 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.364769    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e17688-825a-4a58-b8c9-add3167b546a" containerName="test-curl-7422-139946483124528"
Jul 14 16:35:54.364849 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.364838    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e17688-825a-4a58-b8c9-add3167b546a" containerName="test-curl-7422-139946483124528"
Jul 14 16:35:54.366974 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.366960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:54.379388 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.379370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946477401136"]
Jul 14 16:35:54.483149 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.483126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrgc\" (UniqueName: \"kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc\") pod \"test-curl-7422-139946477401136\" (UID: \"f4ebd33b-fa26-4322-8803-991275244dc1\") " pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:54.584240 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.584180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrgc\" (UniqueName: \"kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc\") pod \"test-curl-7422-139946477401136\" (UID: \"f4ebd33b-fa26-4322-8803-991275244dc1\") " pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:54.599275 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.599250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrgc\" (UniqueName: \"kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc\") pod \"test-curl-7422-139946477401136\" (UID: \"f4ebd33b-fa26-4322-8803-991275244dc1\") " pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:54.675390 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.675370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:54.771495 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.771452    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e17688-825a-4a58-b8c9-add3167b546a" path="/var/lib/kubelet/pods/e5e17688-825a-4a58-b8c9-add3167b546a/volumes"
Jul 14 16:35:54.814779 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:54.814758    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946477401136"]
Jul 14 16:35:54.816243 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:35:54.816222    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ebd33b_fa26_4322_8803_991275244dc1.slice/crio-7d1b2cb2f9616ab615cc3f8c178c93183feeb513fd391f1f2df122b2d996a68e WatchSource:0}: Error finding container 7d1b2cb2f9616ab615cc3f8c178c93183feeb513fd391f1f2df122b2d996a68e: Status 404 returned error can't find the container with id 7d1b2cb2f9616ab615cc3f8c178c93183feeb513fd391f1f2df122b2d996a68e
Jul 14 16:35:55.009436 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:55.009410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946477401136" event={"ID":"f4ebd33b-fa26-4322-8803-991275244dc1","Type":"ContainerStarted","Data":"7d1b2cb2f9616ab615cc3f8c178c93183feeb513fd391f1f2df122b2d996a68e"}
Jul 14 16:35:55.010621 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:55.010604    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946483124528"
Jul 14 16:35:55.010706 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:55.010622    2564 scope.go:117] "RemoveContainer" containerID="0c696610d22fe98f02839d56ce37b314962d647a5d4784c8ce62e050423b9035"
Jul 14 16:35:56.017932 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:56.017858    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4ebd33b-fa26-4322-8803-991275244dc1" containerID="56917250a87ee0c8aa41464fe0bd0c0428f18068c8363096d32298e0fc900954" exitCode=0
Jul 14 16:35:56.018281 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:56.017933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946477401136" event={"ID":"f4ebd33b-fa26-4322-8803-991275244dc1","Type":"ContainerDied","Data":"56917250a87ee0c8aa41464fe0bd0c0428f18068c8363096d32298e0fc900954"}
Jul 14 16:35:57.158422 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.158399    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:57.184633 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.184608    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7422-139946477401136_f4ebd33b-fa26-4322-8803-991275244dc1/test-curl-7422-139946477401136/0.log"
Jul 14 16:35:57.202054 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.202027    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgrgc\" (UniqueName: \"kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc\") pod \"f4ebd33b-fa26-4322-8803-991275244dc1\" (UID: \"f4ebd33b-fa26-4322-8803-991275244dc1\") "
Jul 14 16:35:57.204213 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.204186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc" (OuterVolumeSpecName: "kube-api-access-pgrgc") pod "f4ebd33b-fa26-4322-8803-991275244dc1" (UID: "f4ebd33b-fa26-4322-8803-991275244dc1"). InnerVolumeSpecName "kube-api-access-pgrgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:35:57.208970 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.208948    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7422-139946477401136"]
Jul 14 16:35:57.213103 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.213083    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7422-139946477401136"]
Jul 14 16:35:57.302940 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.302887    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrgc\" (UniqueName: \"kubernetes.io/projected/f4ebd33b-fa26-4322-8803-991275244dc1-kube-api-access-pgrgc\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:35:57.383807 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.383779    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7422-139946477613392"]
Jul 14 16:35:57.384114 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.384102    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ebd33b-fa26-4322-8803-991275244dc1" containerName="test-curl-7422-139946477401136"
Jul 14 16:35:57.384155 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.384115    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ebd33b-fa26-4322-8803-991275244dc1" containerName="test-curl-7422-139946477401136"
Jul 14 16:35:57.384204 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.384195    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ebd33b-fa26-4322-8803-991275244dc1" containerName="test-curl-7422-139946477401136"
Jul 14 16:35:57.386177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.386160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:35:57.402315 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.402292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946477613392"]
Jul 14 16:35:57.504839 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.504817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzb2\" (UniqueName: \"kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2\") pod \"test-curl-7422-139946477613392\" (UID: \"e573e3c5-a45e-41d1-85ae-6248212bc228\") " pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:35:57.605689 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.605631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzb2\" (UniqueName: \"kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2\") pod \"test-curl-7422-139946477613392\" (UID: \"e573e3c5-a45e-41d1-85ae-6248212bc228\") " pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:35:57.614100 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.614078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzb2\" (UniqueName: \"kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2\") pod \"test-curl-7422-139946477613392\" (UID: \"e573e3c5-a45e-41d1-85ae-6248212bc228\") " pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:35:57.694753 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.694730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:35:57.828585 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:57.828562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7422-139946477613392"]
Jul 14 16:35:57.830275 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:35:57.830250    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode573e3c5_a45e_41d1_85ae_6248212bc228.slice/crio-185cd562baf24f1eb902e198f5dce39b274c15ab2cd3db812306db9610e12736 WatchSource:0}: Error finding container 185cd562baf24f1eb902e198f5dce39b274c15ab2cd3db812306db9610e12736: Status 404 returned error can't find the container with id 185cd562baf24f1eb902e198f5dce39b274c15ab2cd3db812306db9610e12736
Jul 14 16:35:58.029779 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:58.029755    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:58.029891 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:58.029781    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d1b2cb2f9616ab615cc3f8c178c93183feeb513fd391f1f2df122b2d996a68e"
Jul 14 16:35:58.031123 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:58.031101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946477613392" event={"ID":"e573e3c5-a45e-41d1-85ae-6248212bc228","Type":"ContainerStarted","Data":"185cd562baf24f1eb902e198f5dce39b274c15ab2cd3db812306db9610e12736"}
Jul 14 16:35:58.040255 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:35:58.040233    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-139946477401136\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" podUID="f4ebd33b-fa26-4322-8803-991275244dc1" pod="openshift-ingress/test-curl-7422-139946477401136"
Jul 14 16:35:58.768129 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:35:58.768105    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ebd33b-fa26-4322-8803-991275244dc1" path="/var/lib/kubelet/pods/f4ebd33b-fa26-4322-8803-991275244dc1/volumes"
Jul 14 16:36:00.504748 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:00.504715    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:36:14.117115 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:14.117081    2564 generic.go:356] "Generic (PLEG): container finished" podID="e573e3c5-a45e-41d1-85ae-6248212bc228" containerID="f72708ea31c9b51bebde9b4fdd821be7db8245009390fedc4bb2755a464db92e" exitCode=0
Jul 14 16:36:14.117570 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:14.117164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7422-139946477613392" event={"ID":"e573e3c5-a45e-41d1-85ae-6248212bc228","Type":"ContainerDied","Data":"f72708ea31c9b51bebde9b4fdd821be7db8245009390fedc4bb2755a464db92e"}
Jul 14 16:36:15.267077 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.267049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:36:15.291467 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.291437    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7422-139946477613392_e573e3c5-a45e-41d1-85ae-6248212bc228/test-curl-7422-139946477613392/0.log"
Jul 14 16:36:15.317090 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.317063    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7422-139946477613392"]
Jul 14 16:36:15.321864 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.321844    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7422-139946477613392"]
Jul 14 16:36:15.347913 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.347894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lzb2\" (UniqueName: \"kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2\") pod \"e573e3c5-a45e-41d1-85ae-6248212bc228\" (UID: \"e573e3c5-a45e-41d1-85ae-6248212bc228\") "
Jul 14 16:36:15.350000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.349970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2" (OuterVolumeSpecName: "kube-api-access-4lzb2") pod "e573e3c5-a45e-41d1-85ae-6248212bc228" (UID: "e573e3c5-a45e-41d1-85ae-6248212bc228"). InnerVolumeSpecName "kube-api-access-4lzb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:36:15.448445 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:15.448414    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lzb2\" (UniqueName: \"kubernetes.io/projected/e573e3c5-a45e-41d1-85ae-6248212bc228-kube-api-access-4lzb2\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:16.129248 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:16.129218    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:36:16.129248 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:16.129239    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="185cd562baf24f1eb902e198f5dce39b274c15ab2cd3db812306db9610e12736"
Jul 14 16:36:16.139335 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:36:16.139307    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-139946477613392\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" podUID="e573e3c5-a45e-41d1-85ae-6248212bc228" pod="openshift-ingress/test-curl-7422-139946477613392"
Jul 14 16:36:16.769444 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:16.769409    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e573e3c5-a45e-41d1-85ae-6248212bc228" path="/var/lib/kubelet/pods/e573e3c5-a45e-41d1-85ae-6248212bc228/volumes"
Jul 14 16:36:25.372947 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:25.372894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:25.472704 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:25.472665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:34.924277 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:34.924251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:36:34.938805 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:34.938781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:36:35.409563 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:35.409486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:38.922578 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:38.922545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:36:39.833438 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:39.833402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:46.403487 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:46.403411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:46.503113 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:46.503076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:46.603728 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:46.603699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:50.537483 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:50.537450    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:36:50.538000 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:50.537693    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" containerID="cri-o://42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264" gracePeriod=30
Jul 14 16:36:50.559208 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:50.559185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:50.845177 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:50.845094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:51.313834 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:51.313800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:51.607990 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:51.607904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:51.709334 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:51.709301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:36:52.031139 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:52.031104    2564 patch_prober.go:28] interesting pod/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:36:52.031307 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:52.031162    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:36:55.790479 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.790456    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:36:55.866821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.866821 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866812    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5xvm\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866863    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866893    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866939    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867001 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.866984    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867251 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867251 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867041    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket\") pod \"01077b36-f053-40e2-9db0-ea470795dac9\" (UID: \"01077b36-f053-40e2-9db0-ea470795dac9\") "
Jul 14 16:36:55.867251 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:36:55.867251 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:36:55.867456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867382    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.867456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867402    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.867456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867399    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:36:55.867817 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.867793    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:36:55.868485 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.868451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data" (OuterVolumeSpecName: "istio-data") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:36:55.869095 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.869072    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm" (OuterVolumeSpecName: "kube-api-access-h5xvm") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "kube-api-access-h5xvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:36:55.869200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.869103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token" (OuterVolumeSpecName: "istio-token") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:36:55.869200 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.869114    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:36:55.869552 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.869535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01077b36-f053-40e2-9db0-ea470795dac9" (UID: "01077b36-f053-40e2-9db0-ea470795dac9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:36:55.968552 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968529    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968552 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968549    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968558    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01077b36-f053-40e2-9db0-ea470795dac9-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968567    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5xvm\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-kube-api-access-h5xvm\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968576    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01077b36-f053-40e2-9db0-ea470795dac9-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968584    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01077b36-f053-40e2-9db0-ea470795dac9-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:55.968700 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:55.968612    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01077b36-f053-40e2-9db0-ea470795dac9-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:36:56.349522 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.349484    2564 generic.go:356] "Generic (PLEG): container finished" podID="01077b36-f053-40e2-9db0-ea470795dac9" containerID="42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264" exitCode=0
Jul 14 16:36:56.349685 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.349549    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"
Jul 14 16:36:56.349685 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.349584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerDied","Data":"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"}
Jul 14 16:36:56.349685 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.349670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l" event={"ID":"01077b36-f053-40e2-9db0-ea470795dac9","Type":"ContainerDied","Data":"a3741024c63368ef8a5deffcb5099cec6f82aed5dc4c5bf0fcc2180e34b70d21"}
Jul 14 16:36:56.349802 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.349697    2564 scope.go:117] "RemoveContainer" containerID="42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"
Jul 14 16:36:56.360802 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.360758    2564 scope.go:117] "RemoveContainer" containerID="af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"
Jul 14 16:36:56.369750 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.369730    2564 scope.go:117] "RemoveContainer" containerID="42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"
Jul 14 16:36:56.370061 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:36:56.370040    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264\": container with ID starting with 42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264 not found: ID does not exist" containerID="42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"
Jul 14 16:36:56.370107 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.370070    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264"} err="failed to get container status \"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264\": rpc error: code = NotFound desc = could not find container \"42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264\": container with ID starting with 42da06d0f944f4e1b23f8eac9c68a829f4bad4f5fbdba14aa7683ede5da2f264 not found: ID does not exist"
Jul 14 16:36:56.370107 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.370091    2564 scope.go:117] "RemoveContainer" containerID="af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"
Jul 14 16:36:56.370391 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:36:56.370369    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234\": container with ID starting with af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234 not found: ID does not exist" containerID="af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"
Jul 14 16:36:56.370446 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.370398    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234"} err="failed to get container status \"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234\": rpc error: code = NotFound desc = could not find container \"af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234\": container with ID starting with af530d9e7d5d8628e83d526c3460f98979e9dd450a17b787b512c6f0b653f234 not found: ID does not exist"
Jul 14 16:36:56.376603 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.376565    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:36:56.380262 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.380240    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-21b35e-openshift-default-7fff85d7cf-l8n7l"]
Jul 14 16:36:56.770045 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:36:56.770020    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01077b36-f053-40e2-9db0-ea470795dac9" path="/var/lib/kubelet/pods/01077b36-f053-40e2-9db0-ea470795dac9/volumes"
Jul 14 16:37:01.664404 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:01.664365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:04.926984 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:04.926941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crvht"]
Jul 14 16:37:06.108288 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:06.108251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:13.127462 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:13.127423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:13.204308 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:13.204270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:16.869866 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:16.869830    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:37:16.870286 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:16.870074    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" containerID="cri-o://93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582" gracePeriod=30
Jul 14 16:37:16.886785 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:16.886759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:17.166231 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:17.166200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:19.046613 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:19.046560    2564 patch_prober.go:28] interesting pod/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 16:37:19.047048 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:19.046645    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 16:37:22.127530 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.127504    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:37:22.272731 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.272869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.272869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.272869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.272869 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.273051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.273051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.273051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.272981    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.273051 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273015    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtkgb\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb\") pod \"a0d728de-b086-464c-b54b-e055adc54fef\" (UID: \"a0d728de-b086-464c-b54b-e055adc54fef\") "
Jul 14 16:37:22.273267 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:22.273267 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273203    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:37:22.273407 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273377    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:22.273492 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273435    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:22.273787 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.273763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:22.275103 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.275063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 16:37:22.275199 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.275113    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:22.275312 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.275291    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:37:22.275659 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.275639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb" (OuterVolumeSpecName: "kube-api-access-vtkgb") pod "a0d728de-b086-464c-b54b-e055adc54fef" (UID: "a0d728de-b086-464c-b54b-e055adc54fef"). InnerVolumeSpecName "kube-api-access-vtkgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:37:22.374138 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374102    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-credential-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374138 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374136    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtkgb\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-kube-api-access-vtkgb\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374138 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374147    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-data\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374156    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d728de-b086-464c-b54b-e055adc54fef-istio-podinfo\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374164    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d728de-b086-464c-b54b-e055adc54fef-istiod-ca-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374172    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d728de-b086-464c-b54b-e055adc54fef-istio-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374180    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-socket\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374187    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-workload-certs\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.374303 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.374196    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d728de-b086-464c-b54b-e055adc54fef-istio-envoy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\""
Jul 14 16:37:22.499324 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.499288    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0d728de-b086-464c-b54b-e055adc54fef" containerID="93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582" exitCode=0
Jul 14 16:37:22.499458 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.499347    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"
Jul 14 16:37:22.499458 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.499380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerDied","Data":"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"}
Jul 14 16:37:22.499458 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.499455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b" event={"ID":"a0d728de-b086-464c-b54b-e055adc54fef","Type":"ContainerDied","Data":"7ce6bc8ef24c88930c5333768e172fc7139f4e194e48dfc1e603e839d2be9c46"}
Jul 14 16:37:22.499656 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.499489    2564 scope.go:117] "RemoveContainer" containerID="93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"
Jul 14 16:37:22.509651 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.509624    2564 scope.go:117] "RemoveContainer" containerID="235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"
Jul 14 16:37:22.518459 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.518438    2564 scope.go:117] "RemoveContainer" containerID="93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"
Jul 14 16:37:22.518773 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:37:22.518752    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582\": container with ID starting with 93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582 not found: ID does not exist" containerID="93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"
Jul 14 16:37:22.518868 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.518785    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582"} err="failed to get container status \"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582\": rpc error: code = NotFound desc = could not find container \"93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582\": container with ID starting with 93d032c400957aa44beeb3590804a1f5d98c2e8423c6d3b1da38920052527582 not found: ID does not exist"
Jul 14 16:37:22.518868 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.518808    2564 scope.go:117] "RemoveContainer" containerID="235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"
Jul 14 16:37:22.519099 ip-10-0-129-145 kubenswrapper[2564]: E0714 16:37:22.519081    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c\": container with ID starting with 235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c not found: ID does not exist" containerID="235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"
Jul 14 16:37:22.519157 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.519108    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c"} err="failed to get container status \"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c\": rpc error: code = NotFound desc = could not find container \"235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c\": container with ID starting with 235d27f133daae6ed9f9e1839a8159becb42dd3656857afa0ee83c9cd6bd956c not found: ID does not exist"
Jul 14 16:37:22.525668 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.525608    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:37:22.529995 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.529968    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4e27c0-openshift-default-5d66f7d879-4lw5b"]
Jul 14 16:37:22.769274 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:22.769250    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0d728de-b086-464c-b54b-e055adc54fef" path="/var/lib/kubelet/pods/a0d728de-b086-464c-b54b-e055adc54fef/volumes"
Jul 14 16:37:23.980579 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:23.980544    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7486689d9d-k4rs7_ff6d9858-a383-4f5d-aca5-87d80bd42278/copy-manifests/0.log"
Jul 14 16:37:23.988777 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:23.988742    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7486689d9d-k4rs7_ff6d9858-a383-4f5d-aca5-87d80bd42278/manager/0.log"
Jul 14 16:37:24.487938 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:24.487908    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734080-5wh5f_e2c349ab-4758-4dde-b514-4b1a39f51087/cleanup/0.log"
Jul 14 16:37:24.958038 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:24.958009    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-9f7be84d-ts9tp_31309cb4-9a78-42af-9a48-b66653aa868b/revoke-keys/0.log"
Jul 14 16:37:25.455912 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:25.455886    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-a2d232-w7kfp_9168f845-e1c6-4da1-9ca9-2cbb678d0eaf/revoke-keys/0.log"
Jul 14 16:37:27.139864 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.139827    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/util/0.log"
Jul 14 16:37:27.158866 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.158839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/pull/0.log"
Jul 14 16:37:27.171848 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.171808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/extract/0.log"
Jul 14 16:37:27.311857 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.311836    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/util/0.log"
Jul 14 16:37:27.324786 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.324766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/pull/0.log"
Jul 14 16:37:27.335361 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.335343    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/extract/0.log"
Jul 14 16:37:27.466452 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.466426    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/util/0.log"
Jul 14 16:37:27.491987 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.491957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/pull/0.log"
Jul 14 16:37:27.501708 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.501682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/extract/0.log"
Jul 14 16:37:27.617184 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.617143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/util/0.log"
Jul 14 16:37:27.625800 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.625777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/pull/0.log"
Jul 14 16:37:27.632061 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:27.632039    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/extract/0.log"
Jul 14 16:37:28.528983 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:28.528955    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-crvht_20bc031a-4d23-450c-8aa4-e1e3b193a10f/limitador/0.log"
Jul 14 16:37:29.039016 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:29.038988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wldcv_2d56cb23-ea4e-4ad7-8e75-d66d41955390/istio-proxy/0.log"
Jul 14 16:37:29.161193 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:29.161151    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q95rm_878bd690-d9ff-422b-a312-af34b271a6eb/discovery/0.log"
Jul 14 16:37:29.888255 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:29.888227    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb9f745b-g8wmm_034a093b-34ab-4624-abc0-42817775338b/router/0.log"
Jul 14 16:37:30.410730 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:30.410694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:35.658156 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658127    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wmsrf/must-gather-p489s"]
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658454    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658466    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658480    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658486    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658503    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.658512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658511    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658522    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658528    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658534    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e573e3c5-a45e-41d1-85ae-6248212bc228" containerName="test-curl-7422-139946477613392"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658540    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e573e3c5-a45e-41d1-85ae-6248212bc228" containerName="test-curl-7422-139946477613392"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658611    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658619    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658626    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="01077b36-f053-40e2-9db0-ea470795dac9" containerName="istio-proxy"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658633    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e573e3c5-a45e-41d1-85ae-6248212bc228" containerName="test-curl-7422-139946477613392"
Jul 14 16:37:35.658727 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.658638    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d728de-b086-464c-b54b-e055adc54fef" containerName="istio-proxy"
Jul 14 16:37:35.663330 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.663310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.667194 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.667168    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wmsrf\"/\"openshift-service-ca.crt\""
Jul 14 16:37:35.667425 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.667399    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wmsrf\"/\"kube-root-ca.crt\""
Jul 14 16:37:35.667529 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.667452    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wmsrf\"/\"default-dockercfg-pvx4s\""
Jul 14 16:37:35.678488 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.678464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wmsrf/must-gather-p489s"]
Jul 14 16:37:35.687966 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.687938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:35.770802 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.770776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/425fc76f-ba8f-447a-ae06-5ff713600a3a-must-gather-output\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.770909 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.770836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2hb\" (UniqueName: \"kubernetes.io/projected/425fc76f-ba8f-447a-ae06-5ff713600a3a-kube-api-access-9x2hb\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.783754 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.783730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log" limit=1024
Jul 14 16:37:35.871578 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.871547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2hb\" (UniqueName: \"kubernetes.io/projected/425fc76f-ba8f-447a-ae06-5ff713600a3a-kube-api-access-9x2hb\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.871716 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.871617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/425fc76f-ba8f-447a-ae06-5ff713600a3a-must-gather-output\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.871876 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.871854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/425fc76f-ba8f-447a-ae06-5ff713600a3a-must-gather-output\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.902160 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.902136    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2hb\" (UniqueName: \"kubernetes.io/projected/425fc76f-ba8f-447a-ae06-5ff713600a3a-kube-api-access-9x2hb\") pod \"must-gather-p489s\" (UID: \"425fc76f-ba8f-447a-ae06-5ff713600a3a\") " pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:35.974772 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:35.974747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wmsrf/must-gather-p489s"
Jul 14 16:37:36.129642 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:36.129616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wmsrf/must-gather-p489s"]
Jul 14 16:37:36.130649 ip-10-0-129-145 kubenswrapper[2564]: W0714 16:37:36.130619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod425fc76f_ba8f_447a_ae06_5ff713600a3a.slice/crio-594645f4f228c15f1680771992cc71fe65a4cce66b6b05f2b23514e7bd256d53 WatchSource:0}: Error finding container 594645f4f228c15f1680771992cc71fe65a4cce66b6b05f2b23514e7bd256d53: Status 404 returned error can't find the container with id 594645f4f228c15f1680771992cc71fe65a4cce66b6b05f2b23514e7bd256d53
Jul 14 16:37:36.579867 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:36.579834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wmsrf/must-gather-p489s" event={"ID":"425fc76f-ba8f-447a-ae06-5ff713600a3a","Type":"ContainerStarted","Data":"594645f4f228c15f1680771992cc71fe65a4cce66b6b05f2b23514e7bd256d53"}
Jul 14 16:37:37.590737 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:37.590699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wmsrf/must-gather-p489s" event={"ID":"425fc76f-ba8f-447a-ae06-5ff713600a3a","Type":"ContainerStarted","Data":"a07eee77cbaf18b9302a21cdba62b65b405c42c2f8720303b79078658bb08752"}
Jul 14 16:37:37.591253 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:37.591227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wmsrf/must-gather-p489s" event={"ID":"425fc76f-ba8f-447a-ae06-5ff713600a3a","Type":"ContainerStarted","Data":"af07c50e4b01ecb0697b7cc16a00bbdbbd1d1a00a0f265afb89994ef10306e75"}
Jul 14 16:37:37.610978 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:37.610933    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wmsrf/must-gather-p489s" podStartSLOduration=1.773158494 podStartE2EDuration="2.610917326s" totalImagesPullingTime="837.758832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:37.609299453 +0000 UTC m=+3063.354695995" watchObservedRunningTime="2026-07-14 16:37:37.610917326 +0000 UTC m=+3063.356313831"
Jul 14 16:37:38.882098 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:38.882066    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zcj7p_acc19301-6af9-4e33-8ec0-44065de95e6c/global-pull-secret-syncer/0.log"
Jul 14 16:37:38.940981 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:38.940949    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-844v5_84fa2297-f2cf-4d60-8d8d-9c6668ca3d8c/konnectivity-agent/0.log"
Jul 14 16:37:39.041998 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:39.041942    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-145.ec2.internal_ec04f0b7858ab684c71a8a77a26f2b63/haproxy/0.log"
Jul 14 16:37:43.504458 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.504396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/extract/0.log"
Jul 14 16:37:43.524875 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.524845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/util/0.log"
Jul 14 16:37:43.560957 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.560924    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75967whr_500c4759-d8e0-4b6a-9fd4-8f38c83f3054/pull/0.log"
Jul 14 16:37:43.594109 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.594026    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/extract/0.log"
Jul 14 16:37:43.619416 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.619323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/util/0.log"
Jul 14 16:37:43.646243 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.646218    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cdrj_ba60fe5c-6d6f-46dd-b5e0-8979a4fda276/pull/0.log"
Jul 14 16:37:43.685142 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.685087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/extract/0.log"
Jul 14 16:37:43.723191 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.723165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/util/0.log"
Jul 14 16:37:43.755922 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.755811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kd5vw_32cd1b0c-0d91-4209-a3ce-ee7970678af4/pull/0.log"
Jul 14 16:37:43.805731 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.805706    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/extract/0.log"
Jul 14 16:37:43.831271 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.831247    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/util/0.log"
Jul 14 16:37:43.867170 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:43.867141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5wbh_a7e9f43c-5cd7-4c20-ba8f-0df9866d0d17/pull/0.log"
Jul 14 16:37:44.502926 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:44.502898    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-crvht_20bc031a-4d23-450c-8aa4-e1e3b193a10f/limitador/0.log"
Jul 14 16:37:46.576930 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:46.576900    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rc2n4_8711b52e-003b-4a47-bb80-b4ba62fe9a71/cluster-monitoring-operator/0.log"
Jul 14 16:37:47.147328 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:47.147300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7ztb_6eed6fef-307b-4dc9-97a8-afc146d7f6ab/node-exporter/0.log"
Jul 14 16:37:47.185721 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:47.185691    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7ztb_6eed6fef-307b-4dc9-97a8-afc146d7f6ab/kube-rbac-proxy/0.log"
Jul 14 16:37:47.224903 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:47.224876    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7ztb_6eed6fef-307b-4dc9-97a8-afc146d7f6ab/init-textfile/0.log"
Jul 14 16:37:47.782760 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:47.782731    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-kbmcn_eeb90ed0-4f57-4c6e-91ba-ae0d7123bedb/prometheus-operator-admission-webhook/0.log"
Jul 14 16:37:49.659365 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:49.659337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/1.log"
Jul 14 16:37:49.665078 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:49.665043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-w5rzb_4ab0686d-01cc-41c6-895e-e2febb797f7d/console-operator/2.log"
Jul 14 16:37:50.220255 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.220230    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-zfc56_f433972e-5606-4e72-90bb-aaf302ed1296/download-server/0.log"
Jul 14 16:37:50.431234 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.431188    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"]
Jul 14 16:37:50.439217 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.439188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.447926 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.447894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"]
Jul 14 16:37:50.508020 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.507920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-lib-modules\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.508020 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.507966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-sys\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.508265 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.508059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-proc\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.508265 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.508120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-podres\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.508265 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.508152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-228dx\" (UniqueName: \"kubernetes.io/projected/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-kube-api-access-228dx\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609547 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-podres\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609547 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-228dx\" (UniqueName: \"kubernetes.io/projected/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-kube-api-access-228dx\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-lib-modules\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-sys\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-proc\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-podres\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-sys\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-lib-modules\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.609813 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.609744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-proc\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.621469 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.621430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-228dx\" (UniqueName: \"kubernetes.io/projected/e0c8b2dc-e9a5-42bb-ae59-32320ffed283-kube-api-access-228dx\") pod \"perf-node-gather-daemonset-l2fz7\" (UID: \"e0c8b2dc-e9a5-42bb-ae59-32320ffed283\") " pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.753581 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.753549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:50.897897 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.897868    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-98zpf_cfa6ce6d-eb90-4616-b0b1-e76e47c0b809/volume-data-source-validator/0.log"
Jul 14 16:37:50.928456 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:50.928278    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"]
Jul 14 16:37:51.691970 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:51.691930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7" event={"ID":"e0c8b2dc-e9a5-42bb-ae59-32320ffed283","Type":"ContainerStarted","Data":"1a8d49c4216e0205024f81004437f77fe7874faac09abf7612e43a1739e7ba6d"}
Jul 14 16:37:51.692173 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:51.691999    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7" event={"ID":"e0c8b2dc-e9a5-42bb-ae59-32320ffed283","Type":"ContainerStarted","Data":"89174f2fb849392382ec381b6f2febd55c2d7ff109f8d6fa53ba1f686fa3cc36"}
Jul 14 16:37:51.692173 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:51.692166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:51.709249 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:51.709192    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7" podStartSLOduration=1.7091779219999998 podStartE2EDuration="1.709177922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:37:51.708065733 +0000 UTC m=+3077.453462256" watchObservedRunningTime="2026-07-14 16:37:51.709177922 +0000 UTC m=+3077.454574449"
Jul 14 16:37:52.129952 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:52.129871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmhk5_05764002-7015-4f8b-a63b-a433ff375ad3/dns/0.log"
Jul 14 16:37:52.151987 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:52.151964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmhk5_05764002-7015-4f8b-a63b-a433ff375ad3/kube-rbac-proxy/0.log"
Jul 14 16:37:52.208698 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:52.208661    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbxkv_6cbdc016-105a-4500-9c29-c0b6786fff34/dns-node-resolver/0.log"
Jul 14 16:37:52.925263 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:52.925235    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbbd6_40d4eb53-5894-4a30-8fd1-709ffc21af97/node-ca/0.log"
Jul 14 16:37:53.905250 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:53.905220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wldcv_2d56cb23-ea4e-4ad7-8e75-d66d41955390/istio-proxy/0.log"
Jul 14 16:37:54.064676 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:54.064647    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q95rm_878bd690-d9ff-422b-a312-af34b271a6eb/discovery/0.log"
Jul 14 16:37:54.261512 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:54.261479    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb9f745b-g8wmm_034a093b-34ab-4624-abc0-42817775338b/router/0.log"
Jul 14 16:37:54.982528 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:54.982487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlb8h_bc060fc8-03e3-4712-b698-4717088a1ed4/serve-healthcheck-canary/0.log"
Jul 14 16:37:55.525504 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:55.525470    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-r5pss_01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a/insights-operator/0.log"
Jul 14 16:37:55.526377 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:55.526351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-r5pss_01f8a8a7-b5f2-4fbd-b6e6-0452c5651f2a/insights-operator/1.log"
Jul 14 16:37:55.635443 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:55.635406    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9d5c_f4ea67fd-567a-479e-b689-14bdc30ffd84/kube-rbac-proxy/0.log"
Jul 14 16:37:55.661128 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:55.661098    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9d5c_f4ea67fd-567a-479e-b689-14bdc30ffd84/exporter/0.log"
Jul 14 16:37:55.685936 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:55.685901    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9d5c_f4ea67fd-567a-479e-b689-14bdc30ffd84/extractor/0.log"
Jul 14 16:37:57.713025 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:57.712997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wmsrf/perf-node-gather-daemonset-l2fz7"
Jul 14 16:37:58.207621 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:58.207567    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wldcv_2d56cb23-ea4e-4ad7-8e75-d66d41955390/istio-proxy/0.log"
Jul 14 16:37:58.355191 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:58.355160    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q95rm_878bd690-d9ff-422b-a312-af34b271a6eb/discovery/0.log"
Jul 14 16:37:58.502344 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:58.502259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb9f745b-g8wmm_034a093b-34ab-4624-abc0-42817775338b/router/0.log"
Jul 14 16:37:58.583151 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:58.583125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7486689d9d-k4rs7_ff6d9858-a383-4f5d-aca5-87d80bd42278/manager/0.log"
Jul 14 16:37:58.609332 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:58.609303    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7486689d9d-k4rs7_ff6d9858-a383-4f5d-aca5-87d80bd42278/copy-manifests/0.log"
Jul 14 16:37:59.889272 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:37:59.889179    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wldcv_2d56cb23-ea4e-4ad7-8e75-d66d41955390/istio-proxy/0.log"
Jul 14 16:38:00.040223 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:38:00.040195    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q95rm_878bd690-d9ff-422b-a312-af34b271a6eb/discovery/0.log"
Jul 14 16:38:00.114548 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:38:00.114509    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-658b99d874-fc949_39156712-ec3f-445f-aa65-66d4dd014714/manager/0.log"
Jul 14 16:38:00.241330 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:38:00.241258    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bb9f745b-g8wmm_034a093b-34ab-4624-abc0-42817775338b/router/0.log"
Jul 14 16:38:06.008179 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:38:06.008140    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8szgb_2468136b-7de7-489b-87de-1c64fdf97409/kube-storage-version-migrator-operator/1.log"
Jul 14 16:38:06.009025 ip-10-0-129-145 kubenswrapper[2564]: I0714 16:38:06.009009    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8szgb_2468136b-7de7-489b-87de-1c64fdf97409/kube-storage-version-migrator-operator/0.log"