Sep 09 17:15:02.549047 ip-10-0-130-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 17:15:02.549059 ip-10-0-130-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 17:15:02.549066 ip-10-0-130-60 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 17:15:02.549423 ip-10-0-130-60 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 17:15:12.798367 ip-10-0-130-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 17:15:12.798382 ip-10-0-130-60 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8d617915ed62465e83cb8cfba4bc41fd --
Sep 09 17:17:08.450332 ip-10-0-130-60 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 17:17:08.863744 ip-10-0-130-60 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 17:17:08.863744 ip-10-0-130-60 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 17:17:08.863744 ip-10-0-130-60 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 17:17:08.863744 ip-10-0-130-60 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 17:17:08.863744 ip-10-0-130-60 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 17:17:08.864604 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.864508    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 17:17:08.867810 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867794    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.867810 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867811    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867816    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867819    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867822    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867825    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867827    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867831    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867836    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867838    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867841    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867844    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867851    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867854    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867857    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867859    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867862    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867866    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867870    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867873    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867877    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.867878 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867879    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867882    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867885    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867889    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867892    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867895    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867897    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867900    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867902    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867905    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867907    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867910    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867912    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867915    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867917    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867920    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867922    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867925    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867927    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867930    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.868384 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867932    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867935    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867937    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867939    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867942    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867945    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867947    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867950    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867952    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867956    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867972    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867974    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867977    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867979    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867983    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867986    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867990    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867992    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867995    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.869195 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.867998    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868000    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868004    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868008    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868011    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868014    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868016    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868019    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868021    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868024    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868027    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868029    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868032    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868034    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868037    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868039    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868042    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868046    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868049    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.869661 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868052    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868054    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868057    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868059    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868062    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868064    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868067    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868070    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868074    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868077    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868079    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868082    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868085    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868088    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868090    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868093    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868095    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868098    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868101    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.868103    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.870142 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869912    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869924    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869927    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869931    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869933    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869936    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869940    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869945    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869947    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869950    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869953    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869956    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869975    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869978    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869981    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869985    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869990    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869993    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869996    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.870619 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.869999    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870001    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870004    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870006    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870009    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870011    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870014    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870016    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870020    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870022    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870025    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870027    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870030    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870033    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870036    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870039    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870042    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870044    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870047    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870049    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.871120 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870052    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870054    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870057    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870059    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870062    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870065    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870067    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870070    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870072    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870075    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870077    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870081    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870085    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870088    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870090    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870093    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870096    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870099    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870101    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.871644 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870104    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870106    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870109    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870112    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870114    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870117    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870119    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870123    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870126    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870128    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870131    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870134    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870137    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870140    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870142    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870145    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870148    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870150    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870153    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870155    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.872135 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870158    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870161    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870163    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870166    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870168    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870172    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870175    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870177    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870180    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870182    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870185    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870187    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870190    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870193    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870195    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870198    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870200    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870203    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870208    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870211    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.872608 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870213    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870597    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870601    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870604    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870609    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870613    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870616    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870619    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870622    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870625    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870628    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870631    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870634    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870637    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870639    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870642    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870644    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870647    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870650    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870652    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.873114 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870655    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870658    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870662    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870666    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870668    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870671    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870674    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870677    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870679    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870682    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870686    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870689    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870691    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870694    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870696    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870699    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870701    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870704    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.873579 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870707    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870709    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870712    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870714    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870717    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870719    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870721    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870724    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870726    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870729    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870731    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870734    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870736    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870739    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870741    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870745    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870748    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870750    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870753    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870756    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.874027 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870758    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870761    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870763    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870766    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870769    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870772    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870774    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870777    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870780    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870782    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870784    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870787    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870790    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870792    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870795    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870797    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870800    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870802    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870805    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870807    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.874510 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870810    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870812    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870815    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870817    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870820    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870823    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870829    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870832    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870834    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870837    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870839    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870842    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870844    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870847    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870849    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870852    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870855    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870857    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870859    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870862    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.875038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870865    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.870867    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.870950    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871011    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871019    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871024    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871028    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871032    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871035    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871040    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871043    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871046    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871049    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871052    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871055    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871058    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871061    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871064    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871069    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871072    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871076    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871079    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871082    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871085    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 17:17:08.875508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871088    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871091    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871095    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871098    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871101    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871104    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871107    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871109    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871112    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871115    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871119    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871122    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871125    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871128    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871131    2559 flags.go:64] FLAG: --enable-server="true"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871134    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871139    2559 flags.go:64] FLAG: --event-burst="100"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871142    2559 flags.go:64] FLAG: --event-qps="50"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871145    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871148    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871150    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871154    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871157    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871160    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871162    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 09 17:17:08.876114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871167    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871171    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871174    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871177    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871180    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871183    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871186    2559 flags.go:64] FLAG: --feature-gates=""
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871189    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871192    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871195    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871198    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871201    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871204    2559 flags.go:64] FLAG: --help="false"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871207    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-60.ec2.internal"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871210    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871213    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871215    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871218    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871222    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871224    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871227    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871229    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871232    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 17:17:08.876698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871235    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871238    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871241    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871243    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871246    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871249    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871251    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871254    2559 flags.go:64] FLAG: --lock-file=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871257    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871261    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871265    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871270    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871274    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871277    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871279    2559 flags.go:64] FLAG: --logging-format="text"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871282    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871285    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871288    2559 flags.go:64] FLAG: --manifest-url=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871291    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871295    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871298    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871302    2559 flags.go:64] FLAG: --max-pods="110"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871305    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871308    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871310    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 17:17:08.877412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871313    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871317    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871320    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871323    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871330    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871333    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871336    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871339    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871341    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871347    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871349    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871352    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871355    2559 flags.go:64] FLAG: --port="10250"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871358    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871361    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01f6ea980243ac473"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871364    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871368    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871371    2559 flags.go:64] FLAG: --register-node="true"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871375    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871378    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871382    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871384    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871387    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871390    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871393    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 17:17:08.878164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871396    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871399    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871402    2559 flags.go:64] FLAG: --runonce="false"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871404    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871407    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871410    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871413    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871416    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871419    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871422    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871425    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871427    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871430    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871433    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871436    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871439    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871442    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871445    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871450    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871453    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871455    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871459    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871461    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871465    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871468    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 17:17:08.879228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871472    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871475    2559 flags.go:64] FLAG: --v="2"
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871478    2559 flags.go:64] FLAG: --version="false"
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871487    2559 flags.go:64] FLAG: --vmodule=""
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871491    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871494    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871603    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871606    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871610    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871613    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871616    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871619    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871621    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871624    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871626    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871629    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871633    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871637    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871640    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871643    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.880321 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871646    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871648    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871651    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871654    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871657    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871659    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871662    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871665    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871668    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871670    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871674    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871677    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871681    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871683    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871686    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871689    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871692    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871694    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871697    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871700    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.880981 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871703    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871705    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871708    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871710    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871713    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871716    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871718    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871721    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871724    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871726    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871729    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871732    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871734    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871737    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871739    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871742    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871745    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871747    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871750    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871752    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.881590 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871755    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871757    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871761    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871765    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871769    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871772    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871775    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871777    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871780    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871787    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871790    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871792    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871795    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871797    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871801    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871805    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871808    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871811    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871813    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.882514 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871816    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871819    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871821    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871824    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871826    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871829    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871832    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871834    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871837    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871839    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871842    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871844    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871847    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871849    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871852    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871855    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871858    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871861    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871864    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871866    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.883124 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871869    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871871    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871874    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871877    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871880    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.871882    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.871888    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.880485    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.880662    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.881347    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.881360    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881448    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881455    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881460    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881464    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.883743 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881468    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881473    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881477    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881484    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881490    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881495    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881499    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881503    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881507    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881511    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881516    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881520    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881524    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881531    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881536    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881541    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881545    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881550    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881555    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.884392 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881559    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881564    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881568    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881572    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881576    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881581    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881587    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881591    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881596    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881600    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881604    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881608    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881612    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881617    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881621    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881625    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881630    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881634    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881638    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.885131 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881642    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881647    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881651    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881655    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881658    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881662    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881667    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881671    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881675    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881679    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881682    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881686    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881690    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881694    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881701    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881706    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881711    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881716    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881721    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881726    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.885783 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881731    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881735    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881739    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881743    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881747    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881751    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881754    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881758    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881762    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881766    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881770    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881774    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881778    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881782    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881786    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881789    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881793    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881798    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881802    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881806    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.886338 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881810    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881814    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881818    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881821    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881825    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881829    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881833    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881837    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881841    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881845    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881849    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881854    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881858    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881863    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881868    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881872    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.886921 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.881876    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.881884    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882075    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882083    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882088    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882093    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882097    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882101    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882105    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882109    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882113    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882117    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882121    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882125    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882129    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 17:17:08.887383 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882133    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882137    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882141    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882145    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882149    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882154    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882158    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882162    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882166    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882170    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882174    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882178    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882183    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882187    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882191    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882196    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882200    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882204    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882208    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882212    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 17:17:08.887756 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882216    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882219    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882223    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882227    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882232    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882236    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882240    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882244    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882248    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882253    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882257    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882262    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882266    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882270    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882274    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882279    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882282    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882286    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882290    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 17:17:08.888290 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882294    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882299    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882303    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882307    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882311    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882315    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882319    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882323    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882327    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882332    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882338    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882343    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882347    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882351    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882355    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882362    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882367    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882372    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882377    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 17:17:08.888751 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882381    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882386    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882390    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882395    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882402    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882407    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882411    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882415    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882419    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882424    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882427    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882432    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882437    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882441    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882445    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882449    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882453    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882457    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882461    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 17:17:08.889409 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882465    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882469    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882473    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882477    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882482    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882486    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882490    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882494    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:08.882498    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.882506    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.882657    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.885480    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.886521    2559 server.go:1019] "Starting client certificate rotation"
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.886624    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 17:17:08.890186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.886660    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 17:17:08.890807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.889720    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 17:17:08.892095 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.892076    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 17:17:08.902298 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.902282    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 09 17:17:08.906306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.906290    2559 log.go:25] "Validated CRI v1 image API"
Sep 09 17:17:08.907147 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.907132    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 17:17:08.909594 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.909574    2559 fs.go:135] Filesystem UUIDs: map[4fccc3eb-39fb-4db1-90f6-578aa4c4fc80:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a48c587a-b793-4814-a985-23ebeec8b587:/dev/nvme0n1p3]
Sep 09 17:17:08.909680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.909593    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 17:17:08.917811 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.917789    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 17:17:08.918043 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.917895    2559 manager.go:216] Machine: {Timestamp:2026-09-09 17:17:08.913382841 +0000 UTC m=+0.330980009 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3067220 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf8ea5731687d19dfdb681438becf SystemUUID:ec2cf8ea-5731-687d-19df-db681438becf BootID:8d617915-ed62-465e-83cb-8cfba4bc41fd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:29:34:91:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:29:34:91:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:28:17:4a:9a:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 17:17:08.918108 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.918043    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 17:17:08.918176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.918165    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 17:17:08.921328 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.921304    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 17:17:08.921461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.921331    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 17:17:08.922696 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.922686    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 17:17:08.922729 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.922699    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 17:17:08.922729 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.922707    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 17:17:08.923303 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.923292    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 17:17:08.924698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.924689    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 17:17:08.927881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.927871    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 17:17:08.928010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928001    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 17:17:08.928047 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928040    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 17:17:08.928077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928056    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 17:17:08.928077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928067    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 17:17:08.928077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928077    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 09 17:17:08.928162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928086    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 17:17:08.928410 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928389    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 17:17:08.928410 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.928411    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 17:17:08.930163 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.930144    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 17:17:08.932715 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932702    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 17:17:08.932766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932732    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 17:17:08.932878 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932869    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 17:17:08.932911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932884    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 17:17:08.932911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932890    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 17:17:08.932911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932895    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 17:17:08.932911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932903    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 17:17:08.932911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.932908    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 17:17:08.933300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933291    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 17:17:08.933331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933300    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 17:17:08.933331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933308    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 17:17:08.933331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933314    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 17:17:08.933331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933322    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 17:17:08.933331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.933329    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 17:17:08.934051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.934042    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 17:17:08.934086 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.934052    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 17:17:08.937979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.937947    2559 server.go:1268] "Started kubelet"
Sep 09 17:17:08.938056 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.938022    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 17:17:08.938130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.938084    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 17:17:08.938180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.938153    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 17:17:08.938698 ip-10-0-130-60 systemd[1]: Started Kubernetes Kubelet.
Sep 09 17:17:08.939089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.939068    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 17:17:08.939293 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.939274    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 17:17:08.939293 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.939277    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 17:17:08.939824 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.939814    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 17:17:08.943231 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.943203    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fz9rd"
Sep 09 17:17:08.943702 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.943684    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 17:17:08.944227 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.944157    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 17:17:08.946825 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.945720    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-60.ec2.internal.18d3b695342c4ceb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-60.ec2.internal,UID:ip-10-0-130-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-60.ec2.internal,},FirstTimestamp:2026-09-09 17:17:08.937919723 +0000 UTC m=+0.355516863,LastTimestamp:2026-09-09 17:17:08.937919723 +0000 UTC m=+0.355516863,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-60.ec2.internal,}"
Sep 09 17:17:08.948264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.948128    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 17:17:08.948339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.948322    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fz9rd"
Sep 09 17:17:08.948680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.948665    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 17:17:08.949009 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.948986    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:08.949420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949402    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 17:17:08.949420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949407    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 17:17:08.949526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949430    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 17:17:08.949579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949524    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 17:17:08.949579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949535    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 17:17:08.949758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949743    2559 factory.go:55] Registering systemd factory
Sep 09 17:17:08.949844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.949763    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 09 17:17:08.950022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950007    2559 factory.go:153] Registering CRI-O factory
Sep 09 17:17:08.950065 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950027    2559 factory.go:223] Registration of the crio container factory successfully
Sep 09 17:17:08.950110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950079    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 17:17:08.950110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950101    2559 factory.go:103] Registering Raw factory
Sep 09 17:17:08.950181 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950114    2559 manager.go:1196] Started watching for new ooms in manager
Sep 09 17:17:08.950503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.950489    2559 manager.go:349] Starting recovery of all containers
Sep 09 17:17:08.953406 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.953374    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 17:17:08.953541 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.953501    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 17:17:08.960748 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.960729    2559 manager.go:354] Recovery completed
Sep 09 17:17:08.965235 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.965222    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:08.967114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967099    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:08.967166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967133    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:08.967166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967142    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:08.967693 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967679    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 17:17:08.967693 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967691    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:08.967784 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967693    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 17:17:08.967784 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.967738    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 17:17:08.968395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968366    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:08.968395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968392    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:08.968487 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968405    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:08.968796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968779    2559 policy_none.go:49] "None policy: Start"
Sep 09 17:17:08.968796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968797    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 17:17:08.968889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.968807    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 17:17:08.969825 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.969813    2559 policy_none.go:47] "Start"
Sep 09 17:17:08.999491 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.999479    2559 manager.go:337] "Starting Device Plugin manager"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:08.999510    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.999528    2559 server.go:87] "Starting device plugin registration server"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.999808    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.999821    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:08.999907    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.000004    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.000014    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.000487    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 17:17:09.017650 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.000529    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.044630 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.044598    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 17:17:09.045869 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.045852    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 17:17:09.045953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.045900    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 17:17:09.045953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.045923    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 17:17:09.046081 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.045976    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 17:17:09.048195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.048178    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 17:17:09.100053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.100034    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:09.100930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.100916    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:09.101019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.100944    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:09.101019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.100955    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:09.101019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.100998    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.108264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.108251    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.108308 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.108271    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-60.ec2.internal\": node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.125498 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.125433    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.146852 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.146832    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"]
Sep 09 17:17:09.146903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.146895    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:09.148383 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.148370    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:09.148443 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.148395    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:09.148443 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.148404    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:09.149719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.149706    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:09.149838 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.149824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.149894 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.149852    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:09.149894 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.149876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d328caa67c7e9fc54aec218f9841f8a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-60.ec2.internal\" (UID: \"d328caa67c7e9fc54aec218f9841f8a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.150412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150397    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:09.150477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150424    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:09.150477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150438    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:09.150477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150451    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:09.150477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150470    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:09.150613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.150483    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:09.151618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.151604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.151680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.151629    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 17:17:09.152280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.152264    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 17:17:09.152349 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.152291    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 17:17:09.152349 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.152304    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeHasSufficientPID"
Sep 09 17:17:09.164465 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.164450    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-60.ec2.internal\" not found" node="ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.168163 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.168149    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-60.ec2.internal\" not found" node="ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.226314 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.226295    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.249970 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.249948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d328caa67c7e9fc54aec218f9841f8a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-60.ec2.internal\" (UID: \"d328caa67c7e9fc54aec218f9841f8a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.250053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.249992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d328caa67c7e9fc54aec218f9841f8a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-60.ec2.internal\" (UID: \"d328caa67c7e9fc54aec218f9841f8a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.327394 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.327374    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.350647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.350626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.350717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.350653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.427882 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.427821    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.451238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.451212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.451329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.451243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.451329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.451275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.451329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.451303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d257169eded558bf4a72bedbb364da0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal\" (UID: \"3d257169eded558bf4a72bedbb364da0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.468334 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.468318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.472444 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.472207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:09.528115 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.528091    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.628607 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.628583    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.729093 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.729030    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.829699 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.829667    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.886110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.886087    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 17:17:09.886499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.886215    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 17:17:09.930560 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:09.930534    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:09.956740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.956711    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 17:12:09 +0000 UTC" deadline="2028-05-06 20:14:13.860675527 +0000 UTC"
Sep 09 17:17:09.956740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:09.956736    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14522h57m3.903942357s"
Sep 09 17:17:10.031025 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.030952    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.046211 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:10.046073    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d257169eded558bf4a72bedbb364da0.slice/crio-423aa75347550df8b74407da4eecb19ec594dad1a78ab1146f53088f1f77616c WatchSource:0}: Error finding container 423aa75347550df8b74407da4eecb19ec594dad1a78ab1146f53088f1f77616c: Status 404 returned error can't find the container with id 423aa75347550df8b74407da4eecb19ec594dad1a78ab1146f53088f1f77616c
Sep 09 17:17:10.046731 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:10.046713    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd328caa67c7e9fc54aec218f9841f8a5.slice/crio-cc497c34e95854434a6635ecee483993f125a6e0acccfcada0863318bda3a6ae WatchSource:0}: Error finding container cc497c34e95854434a6635ecee483993f125a6e0acccfcada0863318bda3a6ae: Status 404 returned error can't find the container with id cc497c34e95854434a6635ecee483993f125a6e0acccfcada0863318bda3a6ae
Sep 09 17:17:10.052510 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.052496    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 17:17:10.131289 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.131256    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.231819 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.231791    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.332340 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.332281    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.423339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.423322    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 17:17:10.432720 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.432697    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.443945 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.443925    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 17:17:10.532790 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.532760    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-60.ec2.internal\" not found"
Sep 09 17:17:10.534032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.534015    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 17:17:10.549357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.549334    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:10.556434 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.556417    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 17:17:10.557438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.557427    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal"
Sep 09 17:17:10.566329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.566308    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 17:17:10.928997 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.928727    2559 apiserver.go:52] "Watching apiserver"
Sep 09 17:17:10.935587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.935506    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 17:17:10.938248 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.937857    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-stlwc","openshift-ovn-kubernetes/ovnkube-node-vctmh","kube-system/global-pull-secret-syncer-rtgmx","kube-system/konnectivity-agent-np62x","openshift-cluster-node-tuning-operator/tuned-dpqxz","openshift-dns/node-resolver-hvkwc","openshift-image-registry/node-ca-ws7cp","openshift-multus/multus-8s9jj","openshift-multus/multus-additional-cni-plugins-98rq7","openshift-multus/network-metrics-daemon-28drg","kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal","openshift-network-diagnostics/network-check-target-skxqw"]
Sep 09 17:17:10.940036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.939788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:10.942356 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.941995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.943494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.943128    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.943494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.943160    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptp86\""
Sep 09 17:17:10.943494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.943321    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 17:17:10.943494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.943378    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.944202 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.943899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:10.944202 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.944008    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:10.944202 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.944188    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.945532 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.945509    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.945624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.945533    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 17:17:10.945936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.945920    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vlbqv\""
Sep 09 17:17:10.946124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.946103    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 17:17:10.948335 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.948315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:10.950264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.950240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.950564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.950542    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 17:17:10.950997 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.950976    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 17:17:10.951103 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.951087    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rrsh8\""
Sep 09 17:17:10.951214 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.951195    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 17:17:10.952167 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.952146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:10.957193 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957170    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.957483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.957637 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957619    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hb4b5\""
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957714    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957731    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qwkkc\""
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957914    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.957918    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5fmv\" (UniqueName: \"kubernetes.io/projected/d38a97fc-641a-412e-aa97-0f6c934af077-kube-api-access-t5fmv\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-multus\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958526    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-dbus\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-systemd\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958599    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-host\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-cnibin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-cni-binary-copy\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-socket-dir-parent\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-netns\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-multus-certs\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-etc-kubernetes\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c59119c0-41e0-4461-be60-660e46d89b1d-agent-certs\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-system-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.959150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c59119c0-41e0-4461-be60-660e46d89b1d-konnectivity-ca\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-modprobe-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysconfig\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-run\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.958992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-tmp\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-bin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnqlm\" (UniqueName: \"kubernetes.io/projected/dac8adea-7679-4725-947e-d06c97790af2-kube-api-access-vnqlm\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-kubernetes\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx65m\" (UniqueName: \"kubernetes.io/projected/28e7e799-a82e-4bc3-b751-82b3701b04af-kube-api-access-kx65m\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-kubelet\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-hostroot\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-lib-modules\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-var-lib-kubelet\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-etc-tuned\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.960320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-k8s-cni-cncf-io\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-conf-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-kubelet-config\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-sys\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28e7e799-a82e-4bc3-b751-82b3701b04af-host\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28e7e799-a82e-4bc3-b751-82b3701b04af-serviceca\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-multus-daemon-config\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.959545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-conf\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.960171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:10.961302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.961148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mwv8w\""
Sep 09 17:17:10.961819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.961345    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 17:17:10.961819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.961561    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 17:17:10.961819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.961699    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.962003 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.961990    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.962180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.962154    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 17:17:10.962352 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.962274    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q8xdw\""
Sep 09 17:17:10.962352 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.962344    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:10.962489 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.962412    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:10.962908 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.962893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:10.963130 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:10.963105    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:10.963352 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.963332    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 17:17:10.963597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.963577    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.963682 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.963638    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.964336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964045    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 17:17:10.964336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964052    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 17:17:10.964336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964087    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 17:17:10.964336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964280    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gk86x\""
Sep 09 17:17:10.964336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964303    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 17:17:10.964696 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.964488    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:10.968076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.967104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xqwr7\""
Sep 09 17:17:10.968076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.967194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 17:17:10.968076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.967333    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 17:17:10.968076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.967605    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 17:17:10.986269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.986197    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vffwx"
Sep 09 17:17:10.991497 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.991475    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 17:17:10.993822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:10.993807    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vffwx"
Sep 09 17:17:11.050339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.050316    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 17:17:11.052296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.052252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal" event={"ID":"d328caa67c7e9fc54aec218f9841f8a5","Type":"ContainerStarted","Data":"cc497c34e95854434a6635ecee483993f125a6e0acccfcada0863318bda3a6ae"}
Sep 09 17:17:11.055180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.055152    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal" event={"ID":"3d257169eded558bf4a72bedbb364da0","Type":"ContainerStarted","Data":"423aa75347550df8b74407da4eecb19ec594dad1a78ab1146f53088f1f77616c"}
Sep 09 17:17:11.060625 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-k8s-cni-cncf-io\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.060625 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-conf-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.060625 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-sys\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-iptables-alerter-script\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-sys\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-conf-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-k8s-cni-cncf-io\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-systemd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-ovn\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.060893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-multus-daemon-config\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5fmv\" (UniqueName: \"kubernetes.io/projected/d38a97fc-641a-412e-aa97-0f6c934af077-kube-api-access-t5fmv\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-host-slash\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.060965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-config\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-script-lib\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-systemd\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-socket-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlhqp\" (UniqueName: \"kubernetes.io/projected/193c1ede-f459-4d14-b891-065933f64baf-kube-api-access-jlhqp\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-system-cni-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-systemd\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-cni-binary-copy\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-netns\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-etc-kubernetes\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c59119c0-41e0-4461-be60-660e46d89b1d-agent-certs\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c59119c0-41e0-4461-be60-660e46d89b1d-konnectivity-ca\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-netns\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-run\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.061314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-etc-kubernetes\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-etc-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-system-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysconfig\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-tmp\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-run\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193c1ede-f459-4d14-b891-065933f64baf-hosts-file\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-systemd-units\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-log-socket\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-bin\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-system-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysconfig\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-cnibin\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-bin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-sys-fs\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-bin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-kubelet\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-kubelet\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-kubelet\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c59119c0-41e0-4461-be60-660e46d89b1d-konnectivity-ca\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-etc-tuned\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-device-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061914    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-netd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.061959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsxj\" (UniqueName: \"kubernetes.io/projected/f6305232-c046-439f-91a5-8631ce940e6b-kube-api-access-7hsxj\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-kubelet-config\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28e7e799-a82e-4bc3-b751-82b3701b04af-host\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28e7e799-a82e-4bc3-b751-82b3701b04af-serviceca\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-conf\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.062969 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062106    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-kubelet-config\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsrsb\" (UniqueName: \"kubernetes.io/projected/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kube-api-access-lsrsb\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193c1ede-f459-4d14-b891-065933f64baf-tmp-dir\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-cni-binary-copy\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28e7e799-a82e-4bc3-b751-82b3701b04af-host\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-env-overrides\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-multus\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-dbus\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dac8adea-7679-4725-947e-d06c97790af2-multus-daemon-config\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-conf\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-host\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-var-lib-cni-multus\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-host\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72d0c9b2-8069-453f-b611-a25066960de5-dbus\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jz7\" (UniqueName: \"kubernetes.io/projected/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-kube-api-access-52jz7\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.062447    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:11.063657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-var-lib-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.062523    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:11.562501705 +0000 UTC m=+2.980098841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28e7e799-a82e-4bc3-b751-82b3701b04af-serviceca\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-cnibin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-socket-dir-parent\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-multus-certs\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-socket-dir-parent\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-cnibin\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-modprobe-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-host-run-multus-certs\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-modprobe-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-node-log\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7380873-1b36-42ad-bf1a-c8389ce43747-ovn-node-metrics-cert\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-sysctl-d\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnqlm\" (UniqueName: \"kubernetes.io/projected/dac8adea-7679-4725-947e-d06c97790af2-kube-api-access-vnqlm\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-kubernetes\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.062959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-netns\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v75t\" (UniqueName: \"kubernetes.io/projected/e7380873-1b36-42ad-bf1a-c8389ce43747-kube-api-access-2v75t\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-etc-kubernetes\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx65m\" (UniqueName: \"kubernetes.io/projected/28e7e799-a82e-4bc3-b751-82b3701b04af-kube-api-access-kx65m\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-hostroot\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-lib-modules\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-registration-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-hostroot\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dac8adea-7679-4725-947e-d06c97790af2-multus-cni-dir\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-slash\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063221    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-lib-modules\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-var-lib-kubelet\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.064783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzlf9\" (UniqueName: \"kubernetes.io/projected/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-kube-api-access-bzlf9\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.065454 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38a97fc-641a-412e-aa97-0f6c934af077-var-lib-kubelet\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.065454 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.063301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:11.066212 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.066192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-tmp\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.066300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.066233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38a97fc-641a-412e-aa97-0f6c934af077-etc-tuned\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.067675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.067648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c59119c0-41e0-4461-be60-660e46d89b1d-agent-certs\") pod \"konnectivity-agent-np62x\" (UID: \"c59119c0-41e0-4461-be60-660e46d89b1d\") " pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:11.071095 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.071075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5fmv\" (UniqueName: \"kubernetes.io/projected/d38a97fc-641a-412e-aa97-0f6c934af077-kube-api-access-t5fmv\") pod \"tuned-dpqxz\" (UID: \"d38a97fc-641a-412e-aa97-0f6c934af077\") " pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.071903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.071847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnqlm\" (UniqueName: \"kubernetes.io/projected/dac8adea-7679-4725-947e-d06c97790af2-kube-api-access-vnqlm\") pod \"multus-8s9jj\" (UID: \"dac8adea-7679-4725-947e-d06c97790af2\") " pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.072222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.072202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx65m\" (UniqueName: \"kubernetes.io/projected/28e7e799-a82e-4bc3-b751-82b3701b04af-kube-api-access-kx65m\") pod \"node-ca-ws7cp\" (UID: \"28e7e799-a82e-4bc3-b751-82b3701b04af\") " pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.164307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-etc-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193c1ede-f459-4d14-b891-065933f64baf-hosts-file\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-systemd-units\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-log-socket\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-bin\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-cnibin\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.164480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193c1ede-f459-4d14-b891-065933f64baf-hosts-file\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-sys-fs\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-etc-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-bin\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-systemd-units\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-kubelet\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-log-socket\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-device-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-netd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsxj\" (UniqueName: \"kubernetes.io/projected/f6305232-c046-439f-91a5-8631ce940e6b-kube-api-access-7hsxj\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsrsb\" (UniqueName: \"kubernetes.io/projected/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kube-api-access-lsrsb\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193c1ede-f459-4d14-b891-065933f64baf-tmp-dir\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-env-overrides\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.164923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jz7\" (UniqueName: \"kubernetes.io/projected/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-kube-api-access-52jz7\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.164906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-var-lib-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-node-log\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7380873-1b36-42ad-bf1a-c8389ce43747-ovn-node-metrics-cert\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-netns\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v75t\" (UniqueName: \"kubernetes.io/projected/e7380873-1b36-42ad-bf1a-c8389ce43747-kube-api-access-2v75t\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-registration-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-cnibin\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-slash\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-slash\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165724    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzlf9\" (UniqueName: \"kubernetes.io/projected/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-kube-api-access-bzlf9\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.165919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.165859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.166253 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-kubelet\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.166288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.166329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.166370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.166411 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-cni-netd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.166411 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.166526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-sys-fs\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.166953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.166929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6305232-c046-439f-91a5-8631ce940e6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.167124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-env-overrides\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.167124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-node-log\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.167276 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-registration-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.167863 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-run-netns\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.168027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-device-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.168027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193c1ede-f459-4d14-b891-065933f64baf-tmp-dir\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.168027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.167957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-var-lib-openvswitch\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.168237 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.168219    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:11.168350 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.168309    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:11.668286833 +0000 UTC m=+3.085883969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-iptables-alerter-script\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-systemd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-ovn\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-host-slash\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-config\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-script-lib\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7380873-1b36-42ad-bf1a-c8389ce43747-ovn-node-metrics-cert\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.169999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-socket-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhqp\" (UniqueName: \"kubernetes.io/projected/193c1ede-f459-4d14-b891-065933f64baf-kube-api-access-jlhqp\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.170058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-system-cni-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-host-slash\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-socket-dir\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-config\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-ovn\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-run-systemd\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7380873-1b36-42ad-bf1a-c8389ce43747-ovnkube-script-lib\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7380873-1b36-42ad-bf1a-c8389ce43747-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.170752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6305232-c046-439f-91a5-8631ce940e6b-system-cni-dir\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.171152 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.170885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-iptables-alerter-script\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.173048 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.172877    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:11.173048 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.172909    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:11.173048 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.172922    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:11.173048 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.173030    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:11.673011536 +0000 UTC m=+3.090608682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:11.177008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.176979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsrsb\" (UniqueName: \"kubernetes.io/projected/f3429bf2-4046-4746-904b-8ff0f5a5e8ee-kube-api-access-lsrsb\") pod \"aws-ebs-csi-driver-node-df9r5\" (UID: \"f3429bf2-4046-4746-904b-8ff0f5a5e8ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.181703 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.181644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jz7\" (UniqueName: \"kubernetes.io/projected/49f8c995-f9b6-49b6-9c3d-2436f4ee9def-kube-api-access-52jz7\") pod \"iptables-alerter-stlwc\" (UID: \"49f8c995-f9b6-49b6-9c3d-2436f4ee9def\") " pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.182304 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.182175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsxj\" (UniqueName: \"kubernetes.io/projected/f6305232-c046-439f-91a5-8631ce940e6b-kube-api-access-7hsxj\") pod \"multus-additional-cni-plugins-98rq7\" (UID: \"f6305232-c046-439f-91a5-8631ce940e6b\") " pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.182304 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.182189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzlf9\" (UniqueName: \"kubernetes.io/projected/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-kube-api-access-bzlf9\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.183019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.182979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlhqp\" (UniqueName: \"kubernetes.io/projected/193c1ede-f459-4d14-b891-065933f64baf-kube-api-access-jlhqp\") pod \"node-resolver-hvkwc\" (UID: \"193c1ede-f459-4d14-b891-065933f64baf\") " pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.184343 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.184322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v75t\" (UniqueName: \"kubernetes.io/projected/e7380873-1b36-42ad-bf1a-c8389ce43747-kube-api-access-2v75t\") pod \"ovnkube-node-vctmh\" (UID: \"e7380873-1b36-42ad-bf1a-c8389ce43747\") " pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.262892 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.262641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ws7cp"
Sep 09 17:17:11.270955 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.270932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8s9jj"
Sep 09 17:17:11.283211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.283050    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:11.290913 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.290884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpqxz"
Sep 09 17:17:11.299973 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.299949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvkwc"
Sep 09 17:17:11.309909 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.309885    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-98rq7"
Sep 09 17:17:11.320645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.320622    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-stlwc"
Sep 09 17:17:11.328427 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.328408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:11.343200 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.343167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5"
Sep 09 17:17:11.573156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.573065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:11.573302 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.573239    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:11.573371 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.573311    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:12.573293296 +0000 UTC m=+3.990890439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:11.673885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.673851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:11.674059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.673892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:11.674059 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674041    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:11.674059 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674057    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:11.674160 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674057    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:11.674160 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674067    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:11.674160 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674129    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:12.674109292 +0000 UTC m=+4.091706422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:11.674160 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:11.674151    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:12.674139669 +0000 UTC m=+4.091736801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:11.995759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.995691    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 17:12:11 +0000 UTC" deadline="2028-03-25 00:28:16.918817413 +0000 UTC"
Sep 09 17:17:11.995759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:11.995752    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h11m4.923069544s"
Sep 09 17:17:12.046527 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.046485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:12.046662 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.046629    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:12.046731 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.046678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:12.046837 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.046806    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:12.202064 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:12.202001    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6305232_c046_439f_91a5_8631ce940e6b.slice/crio-24fc793a2eaa796e7272854b8c6345bd5e1454972ebf630e07ebd6be9e76befe WatchSource:0}: Error finding container 24fc793a2eaa796e7272854b8c6345bd5e1454972ebf630e07ebd6be9e76befe: Status 404 returned error can't find the container with id 24fc793a2eaa796e7272854b8c6345bd5e1454972ebf630e07ebd6be9e76befe
Sep 09 17:17:12.211714 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:12.211688    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e7e799_a82e_4bc3_b751_82b3701b04af.slice/crio-111ef6c99ee3d0a86557ceef7887edb13ede1124d120c698b4e9044a9e06e22d WatchSource:0}: Error finding container 111ef6c99ee3d0a86557ceef7887edb13ede1124d120c698b4e9044a9e06e22d: Status 404 returned error can't find the container with id 111ef6c99ee3d0a86557ceef7887edb13ede1124d120c698b4e9044a9e06e22d
Sep 09 17:17:12.213033 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:12.212911    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193c1ede_f459_4d14_b891_065933f64baf.slice/crio-26469cde814167331f40150167a60f1da1cf08cdd34c241247dd58f451621445 WatchSource:0}: Error finding container 26469cde814167331f40150167a60f1da1cf08cdd34c241247dd58f451621445: Status 404 returned error can't find the container with id 26469cde814167331f40150167a60f1da1cf08cdd34c241247dd58f451621445
Sep 09 17:17:12.214249 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:12.214225    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7380873_1b36_42ad_bf1a_c8389ce43747.slice/crio-462f23a33f9f8595969b4c324ed2668310015ed9a206635b2cd401d919b4e425 WatchSource:0}: Error finding container 462f23a33f9f8595969b4c324ed2668310015ed9a206635b2cd401d919b4e425: Status 404 returned error can't find the container with id 462f23a33f9f8595969b4c324ed2668310015ed9a206635b2cd401d919b4e425
Sep 09 17:17:12.214844 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:12.214734    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59119c0_41e0_4461_be60_660e46d89b1d.slice/crio-b43de51a186440ad4370fd1d816c179f9470d12d9df41f018471e6f41544edfe WatchSource:0}: Error finding container b43de51a186440ad4370fd1d816c179f9470d12d9df41f018471e6f41544edfe: Status 404 returned error can't find the container with id b43de51a186440ad4370fd1d816c179f9470d12d9df41f018471e6f41544edfe
Sep 09 17:17:12.584463 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.584429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:12.584574 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.584542    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:12.584626 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.584590    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:14.584577602 +0000 UTC m=+6.002174730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:12.685582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.685537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:12.685730 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.685607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:12.685800 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685763    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:12.685800 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685770    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:12.685800 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685793    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:12.685923 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685808    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:12.685923 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685834    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:14.685813945 +0000 UTC m=+6.103411077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:12.685923 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:12.685869    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:14.68584236 +0000 UTC m=+6.103439494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:12.996806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.996747    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 17:12:11 +0000 UTC" deadline="2028-03-13 06:57:00.222770411 +0000 UTC"
Sep 09 17:17:12.996806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:12.996781    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13213h39m47.225993622s"
Sep 09 17:17:13.049013 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.048942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:13.049173 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:13.049104    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:13.064530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.064492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8s9jj" event={"ID":"dac8adea-7679-4725-947e-d06c97790af2","Type":"ContainerStarted","Data":"958216cbf7b375662a54e46398753fe5c023b4c55531fab191fe4c9fa04198fc"}
Sep 09 17:17:13.069506 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.069427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpqxz" event={"ID":"d38a97fc-641a-412e-aa97-0f6c934af077","Type":"ContainerStarted","Data":"54df0b2318771165b04bde760a46f24133aeddc6f73e78d34cb982a19c1e4b98"}
Sep 09 17:17:13.071954 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.071890    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-np62x" event={"ID":"c59119c0-41e0-4461-be60-660e46d89b1d","Type":"ContainerStarted","Data":"b43de51a186440ad4370fd1d816c179f9470d12d9df41f018471e6f41544edfe"}
Sep 09 17:17:13.080772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.080386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"462f23a33f9f8595969b4c324ed2668310015ed9a206635b2cd401d919b4e425"}
Sep 09 17:17:13.090465 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.090181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-stlwc" event={"ID":"49f8c995-f9b6-49b6-9c3d-2436f4ee9def","Type":"ContainerStarted","Data":"7a2966070fb62302993301d5904a1908dd9934f39a0014191a56ebd319fa40f3"}
Sep 09 17:17:13.092792 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.092726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerStarted","Data":"24fc793a2eaa796e7272854b8c6345bd5e1454972ebf630e07ebd6be9e76befe"}
Sep 09 17:17:13.096604 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.096576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvkwc" event={"ID":"193c1ede-f459-4d14-b891-065933f64baf","Type":"ContainerStarted","Data":"26469cde814167331f40150167a60f1da1cf08cdd34c241247dd58f451621445"}
Sep 09 17:17:13.101457 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.101397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ws7cp" event={"ID":"28e7e799-a82e-4bc3-b751-82b3701b04af","Type":"ContainerStarted","Data":"111ef6c99ee3d0a86557ceef7887edb13ede1124d120c698b4e9044a9e06e22d"}
Sep 09 17:17:13.103795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.103719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5" event={"ID":"f3429bf2-4046-4746-904b-8ff0f5a5e8ee","Type":"ContainerStarted","Data":"9507df71ba3adf29c1e9797adf899f342a4c9c9312f0e6caa436af1c24b0872f"}
Sep 09 17:17:13.113439 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.112749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal" event={"ID":"d328caa67c7e9fc54aec218f9841f8a5","Type":"ContainerStarted","Data":"f6fa57ff38bcd5f216cf98f251d5732d06f91b8a971255b1e3b089d054057018"}
Sep 09 17:17:13.115724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.115695    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d257169eded558bf4a72bedbb364da0" containerID="a1b6ddf5545c69db3cce8e7a879bb48315a8af8ff97087dc675aaae2856184fa" exitCode=0
Sep 09 17:17:13.115828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.115736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal" event={"ID":"3d257169eded558bf4a72bedbb364da0","Type":"ContainerDied","Data":"a1b6ddf5545c69db3cce8e7a879bb48315a8af8ff97087dc675aaae2856184fa"}
Sep 09 17:17:13.127282 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:13.127226    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-60.ec2.internal" podStartSLOduration=3.12716513 podStartE2EDuration="3.12716513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:13.126658134 +0000 UTC m=+4.544255288" watchObservedRunningTime="2026-09-09 17:17:13.12716513 +0000 UTC m=+4.544762283"
Sep 09 17:17:14.046511 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.046247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:14.047025 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.046290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:14.047025 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.046645    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:14.047025 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.046722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:14.152148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.152103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal" event={"ID":"3d257169eded558bf4a72bedbb364da0","Type":"ContainerStarted","Data":"7d7f09bb1e7c9f1f7a36baf12572a3827c50869e6a1a613e42779bf4b386a511"}
Sep 09 17:17:14.610587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.609963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:14.610587 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.610176    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:14.610587 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.610242    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:18.610222651 +0000 UTC m=+10.027819794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.710359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:14.710413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.710573    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.710592    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.710605    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.710662    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:18.710643287 +0000 UTC m=+10.128240419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.711091    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:14.711190 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:14.711146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:18.711130656 +0000 UTC m=+10.128727788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:15.047207 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:15.047125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:15.047682 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:15.047260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:16.046420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:16.046383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:16.046612 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:16.046503    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:16.046840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:16.046820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:16.046931 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:16.046913    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:17.046333 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:17.046297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:17.046745 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:17.046422    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:18.046653 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:18.046623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:18.047090 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.046762    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:18.047172 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:18.047156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:18.047254 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.047233    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:18.643045 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:18.642925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:18.643213 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.643083    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:18.643213 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.643157    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:26.643135182 +0000 UTC m=+18.060732328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:18.743914 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:18.743880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:18.744091 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:18.743933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:18.744091 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744046    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:18.744193 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744096    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:18.744193 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744113    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:18.744193 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744124    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:18.744193 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744154    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:26.744131592 +0000 UTC m=+18.161728731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:18.744193 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:18.744174    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:26.744162954 +0000 UTC m=+18.161760081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:19.047312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:19.047235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:19.047730 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:19.047337    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:20.047148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:20.046683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:20.047148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:20.046732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:20.047148 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:20.046818    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:20.047148 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:20.046974    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:21.048639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:21.048163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:21.048639 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:21.048296    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:22.047053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:22.047015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:22.047228 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:22.047158    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:22.047315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:22.047237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:22.047372 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:22.047314    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:23.046306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:23.046278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:23.046705 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:23.046396    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:24.047118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:24.047086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:24.047574 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:24.047131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:24.047574 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:24.047205    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:24.047574 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:24.047354    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:25.046613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:25.046581    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:25.046768 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:25.046708    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:26.046859 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:26.046828    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:26.047240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:26.046830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:26.047240 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.046920    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:26.047240 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.047030    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:26.702772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:26.702734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:26.702992 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.702923    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:26.703059 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.703032    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:42.703010416 +0000 UTC m=+34.120607557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:26.803584 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:26.803547    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:26.803746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:26.803599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:26.803746 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803713    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:26.803746 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803734    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:26.803919 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803750    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:26.803919 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803764    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:26.803919 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803786    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:42.803760963 +0000 UTC m=+34.221358093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:26.803919 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:26.803811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:42.803796891 +0000 UTC m=+34.221394019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:27.047130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:27.047049    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:27.047540 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:27.047174    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:28.046729 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:28.046695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:28.046910 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:28.046695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:28.046910 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:28.046813    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:28.047060 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:28.046934    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:29.047262 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:29.047230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:29.047691 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:29.047341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:30.047049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:30.046984    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:30.047168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:30.046989    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:30.047168 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:30.047085    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:30.047258 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:30.047170    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:31.046868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.046686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:31.047612 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:31.046986    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:31.191081 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.190999    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8s9jj" event={"ID":"dac8adea-7679-4725-947e-d06c97790af2","Type":"ContainerStarted","Data":"bda6a93d4b63ad8e6ab0349d8d4a3e506f533efc62014e9765db6b0db24dd079"}
Sep 09 17:17:31.192390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.192365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpqxz" event={"ID":"d38a97fc-641a-412e-aa97-0f6c934af077","Type":"ContainerStarted","Data":"b3997d49acb19ac4ef5fdd476852c009a71f905b9b4da60e25a2ac1490eef9c0"}
Sep 09 17:17:31.193785 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.193756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-np62x" event={"ID":"c59119c0-41e0-4461-be60-660e46d89b1d","Type":"ContainerStarted","Data":"2b11a9cd94167621b8b34639a603ab2854932bf85715f7951d32ceec5d523785"}
Sep 09 17:17:31.196254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196236    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:17:31.196603 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196583    2559 generic.go:356] "Generic (PLEG): container finished" podID="e7380873-1b36-42ad-bf1a-c8389ce43747" containerID="7e5e251ed6bb0c53f479888d72bc990c35ba7db2be2b24ecdce78da167b823e8" exitCode=1
Sep 09 17:17:31.196686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"b5b00c8dcebaa2a8febbec4fa95f96f3fd3809d35a4223aa1daa18ad6e368f6f"}
Sep 09 17:17:31.196749 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"51253a43dceab4e24c0291b203107de7611480866f9cbf9b574b683369af4883"}
Sep 09 17:17:31.196749 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"11ceabcc86e41d94f2bed33c4ec8c1a3eaa9c4aa8f85e90a19a0b0c75254244a"}
Sep 09 17:17:31.196831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"9b80818c3aa7c13748cc0e54d094e49f0bb4e1918fbfa70b1a7b849ca6781d46"}
Sep 09 17:17:31.196831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerDied","Data":"7e5e251ed6bb0c53f479888d72bc990c35ba7db2be2b24ecdce78da167b823e8"}
Sep 09 17:17:31.196902 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.196831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"09665f69835bb96e49a5d0091e94ec92319672119d84a9c11a4c22944e00a6f4"}
Sep 09 17:17:31.198122 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.198102    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="c21c70b0c08cc4c68ddcbefd25227cca1ebe66fe921dead3004616eaab2d2e85" exitCode=0
Sep 09 17:17:31.198192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.198177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"c21c70b0c08cc4c68ddcbefd25227cca1ebe66fe921dead3004616eaab2d2e85"}
Sep 09 17:17:31.199597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.199576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvkwc" event={"ID":"193c1ede-f459-4d14-b891-065933f64baf","Type":"ContainerStarted","Data":"c463171a135518de7c7b9a14dabb27c047afcdb0ac1aad1503ebc530140647c7"}
Sep 09 17:17:31.201002 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.200984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ws7cp" event={"ID":"28e7e799-a82e-4bc3-b751-82b3701b04af","Type":"ContainerStarted","Data":"c21bb59772c823afb73641655bb819caf9c24eec43f522dc7cfbb50b441f7bc4"}
Sep 09 17:17:31.202277 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.202261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5" event={"ID":"f3429bf2-4046-4746-904b-8ff0f5a5e8ee","Type":"ContainerStarted","Data":"de242e20e15ac17dc87beb16f90570bcfb8cb79cd4c43a59ec1f37034a936de2"}
Sep 09 17:17:31.210232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.210198    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8s9jj" podStartSLOduration=4.299756266 podStartE2EDuration="22.210187144s" totalImagesPullingTime="17.910430878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:31.208712104 +0000 UTC m=+22.626309253" watchObservedRunningTime="2026-09-09 17:17:31.210187144 +0000 UTC m=+22.627784293"
Sep 09 17:17:31.210455 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.210437    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-60.ec2.internal" podStartSLOduration=21.21043212 podStartE2EDuration="21.21043212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:14.168073529 +0000 UTC m=+5.585670682" watchObservedRunningTime="2026-09-09 17:17:31.21043212 +0000 UTC m=+22.628029270"
Sep 09 17:17:31.221170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.221140    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ws7cp" podStartSLOduration=4.346931899 podStartE2EDuration="22.221128798s" totalImagesPullingTime="17.874196899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:31.22101896 +0000 UTC m=+22.638616108" watchObservedRunningTime="2026-09-09 17:17:31.221128798 +0000 UTC m=+22.638725947"
Sep 09 17:17:31.236040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.236002    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dpqxz" podStartSLOduration=4.367718616 podStartE2EDuration="22.235993639s" totalImagesPullingTime="17.868275023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:31.235558214 +0000 UTC m=+22.653155364" watchObservedRunningTime="2026-09-09 17:17:31.235993639 +0000 UTC m=+22.653590787"
Sep 09 17:17:31.250155 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.250117    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hvkwc" podStartSLOduration=4.735425429 podStartE2EDuration="22.250106216s" totalImagesPullingTime="17.514680787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:31.249846675 +0000 UTC m=+22.667443824" watchObservedRunningTime="2026-09-09 17:17:31.250106216 +0000 UTC m=+22.667703365"
Sep 09 17:17:31.286513 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.286472    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-np62x" podStartSLOduration=4.77496471 podStartE2EDuration="22.286460683s" totalImagesPullingTime="17.511495973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:31.286152173 +0000 UTC m=+22.703749321" watchObservedRunningTime="2026-09-09 17:17:31.286460683 +0000 UTC m=+22.704057834"
Sep 09 17:17:31.365380 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.365321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:31.434786 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.434759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:31.571509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:31.571488    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 17:17:32.014575 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.014480    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T17:17:31.571505512Z","UUID":"afe7e0e4-e5a9-48b7-ac07-e66c608cc88e","Handler":null,"Name":"","Endpoint":""}
Sep 09 17:17:32.016031 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.016008    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 17:17:32.016137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.016043    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 17:17:32.046468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.046445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:32.046614 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.046480    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:32.046681 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:32.046632    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:32.046733 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:32.046685    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:32.207068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.207028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-stlwc" event={"ID":"49f8c995-f9b6-49b6-9c3d-2436f4ee9def","Type":"ContainerStarted","Data":"ccac28d56a6d12768501bba0ef4fc75750f5476346632c015df989ddb1cd0859"}
Sep 09 17:17:32.210100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.210067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5" event={"ID":"f3429bf2-4046-4746-904b-8ff0f5a5e8ee","Type":"ContainerStarted","Data":"6ec8c73c9fcaeb5d4d45740238456dfa3e8cbc7b2acd226d2b0bb6f7233936c4"}
Sep 09 17:17:32.341562 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.341471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:32.400351 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:32.400302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:33.047118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.047090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:33.047332 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:33.047291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:33.215985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.215893    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:17:33.216393 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.216334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"2837c1b5c8e972e039f68cd893b2011d8e03da3862e2c00daa091b53fc41cef3"}
Sep 09 17:17:33.218713 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.218685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5" event={"ID":"f3429bf2-4046-4746-904b-8ff0f5a5e8ee","Type":"ContainerStarted","Data":"aceca035a2bc75def273b7388229ea71e685d53ada3432f47c750d7b6d957bb4"}
Sep 09 17:17:33.224758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.224736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:33.225318 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.225300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:33.238296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.238259    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-df9r5" podStartSLOduration=4.464999567 podStartE2EDuration="24.238246172s" totalImagesPullingTime="19.773246605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:33.236882044 +0000 UTC m=+24.654479193" watchObservedRunningTime="2026-09-09 17:17:33.238246172 +0000 UTC m=+24.655843320"
Sep 09 17:17:33.238485 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:33.238457    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-stlwc" podStartSLOduration=6.360448813 podStartE2EDuration="24.238451106s" totalImagesPullingTime="17.878002293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:32.220712632 +0000 UTC m=+23.638309782" watchObservedRunningTime="2026-09-09 17:17:33.238451106 +0000 UTC m=+24.656048257"
Sep 09 17:17:34.046756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:34.046725    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:34.046927 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:34.046854    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:34.046927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:34.046905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:34.047076 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:34.047019    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:34.221642 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:34.221403    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:34.222004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:34.221755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-np62x"
Sep 09 17:17:34.387886 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:34.387817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:35.046913 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:35.046883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:35.047060 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:35.047035    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:35.068828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:35.068798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:35.128585 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:35.128552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:36.046846 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.046817    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:36.047307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.046817    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:36.047307 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:36.046920    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:36.047307 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:36.047052    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:36.233029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.232834    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:17:36.233447 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.233279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"0ef19897309df9492fa16b0ad73e877e1ce22467e611dbee336b410cffc5dd5e"}
Sep 09 17:17:36.233447 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.233395    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:36.233998 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:36.233698    2559 scope.go:117] "RemoveContainer" containerID="7e5e251ed6bb0c53f479888d72bc990c35ba7db2be2b24ecdce78da167b823e8"
Sep 09 17:17:37.046545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.046375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:37.046716 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:37.046611    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:37.238585 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.238559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:17:37.239059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.238911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" event={"ID":"e7380873-1b36-42ad-bf1a-c8389ce43747","Type":"ContainerStarted","Data":"6578367f1f15026b6d04272cd43e79a7f8ea9f9d186034cc551453c7d822870f"}
Sep 09 17:17:37.239113 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.239098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:37.239169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.239156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:37.241131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.241094    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="d76998a8933195dfc7b1bc1797b150dc2ad00f24642494ad389ba76a7659b70b" exitCode=0
Sep 09 17:17:37.241240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.241150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"d76998a8933195dfc7b1bc1797b150dc2ad00f24642494ad389ba76a7659b70b"}
Sep 09 17:17:37.254866 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.254844    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:37.255044 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.255029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:17:37.269477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:37.269441    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh" podStartSLOduration=10.382891935 podStartE2EDuration="28.269429769s" totalImagesPullingTime="17.886537834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:37.268941558 +0000 UTC m=+28.686538706" watchObservedRunningTime="2026-09-09 17:17:37.269429769 +0000 UTC m=+28.687026918"
Sep 09 17:17:38.047178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.047148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:38.047178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.047186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:38.047392 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:38.047291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:38.047447 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:38.047405    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:38.080407 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.080377    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtgmx"]
Sep 09 17:17:38.084189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.084167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-skxqw"]
Sep 09 17:17:38.084311 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.084251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:38.084366 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:38.084329    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:38.086723 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.086655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28drg"]
Sep 09 17:17:38.246063 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.245863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerStarted","Data":"cf0e09329e9d607f2ac22c57d8350b8486cd0d1f8db9c6f883e05c7f91609705"}
Sep 09 17:17:38.246553 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.245914    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:38.246553 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.245924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:38.246847 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:38.246610    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:38.246847 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:38.246762    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:38.358626 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.358557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:38.472330 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:38.472275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:39.250314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:39.250281    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="cf0e09329e9d607f2ac22c57d8350b8486cd0d1f8db9c6f883e05c7f91609705" exitCode=0
Sep 09 17:17:39.250671 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:39.250367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"cf0e09329e9d607f2ac22c57d8350b8486cd0d1f8db9c6f883e05c7f91609705"}
Sep 09 17:17:40.046340 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:40.046316    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:40.046457 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:40.046401    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:40.046457 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:40.046320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:40.046650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:40.046320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:40.046650 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:40.046525    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:40.046650 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:40.046567    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:40.255047 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:40.255014    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="4762923459affeeadf5f6fe11f2b0984f6b2a64814afb10f366395726f4b4d85" exitCode=0
Sep 09 17:17:40.255391 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:40.255064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"4762923459affeeadf5f6fe11f2b0984f6b2a64814afb10f366395726f4b4d85"}
Sep 09 17:17:42.047166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.047128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:42.047711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.047128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:42.047711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.047132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:42.047711 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.047383    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:17:42.047711 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.047235    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-skxqw" podUID="41fb60e8-682c-4a8c-80a2-2ceb7c92e506"
Sep 09 17:17:42.047711 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.047572    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtgmx" podUID="72d0c9b2-8069-453f-b611-a25066960de5"
Sep 09 17:17:42.725979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.725928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:42.726134 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.726067    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:42.726134 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.726131    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret podName:72d0c9b2-8069-453f-b611-a25066960de5 nodeName:}" failed. No retries permitted until 2026-09-09 17:18:14.726109471 +0000 UTC m=+66.143706600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret") pod "global-pull-secret-syncer-rtgmx" (UID: "72d0c9b2-8069-453f-b611-a25066960de5") : object "kube-system"/"original-pull-secret" not registered
Sep 09 17:17:42.827204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.827169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:42.827327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:42.827220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:42.827383 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827356    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 17:17:42.827383 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827374    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 17:17:42.827527 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827387    2559 projected.go:196] Error preparing data for projected volume kube-api-access-k9wz4 for pod openshift-network-diagnostics/network-check-target-skxqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:42.827527 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827444    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4 podName:41fb60e8-682c-4a8c-80a2-2ceb7c92e506 nodeName:}" failed. No retries permitted until 2026-09-09 17:18:14.827427488 +0000 UTC m=+66.245024635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k9wz4" (UniqueName: "kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4") pod "network-check-target-skxqw" (UID: "41fb60e8-682c-4a8c-80a2-2ceb7c92e506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 17:17:42.827825 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827803    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:42.827887 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:42.827860    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:18:14.82784842 +0000 UTC m=+66.245445547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 17:17:43.291871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.291833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:43.346244 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.346207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:43.406643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.406583    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-60.ec2.internal" event="NodeReady"
Sep 09 17:17:43.406767 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.406712    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 17:17:43.476519 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.476487    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2ht2"]
Sep 09 17:17:43.493046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.493020    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lql8n"]
Sep 09 17:17:43.493174 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.493107    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.495441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.495409    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 17:17:43.495441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.495432    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cblwm\""
Sep 09 17:17:43.495622 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.495602    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 17:17:43.511173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.511137    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2ht2"]
Sep 09 17:17:43.511173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.511173    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lql8n"]
Sep 09 17:17:43.511371 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.511241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.513609 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.513590    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 17:17:43.513609 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.513588    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 17:17:43.513819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.513612    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vg7zn\""
Sep 09 17:17:43.513819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.513713    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 17:17:43.613741 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.613693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:43.632699 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.632664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-config-volume\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.632842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.632707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9df9e62-7b30-46f5-937e-7629b918f504-cert\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.632887 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.632831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v77b\" (UniqueName: \"kubernetes.io/projected/f9df9e62-7b30-46f5-937e-7629b918f504-kube-api-access-7v77b\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.632887 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.632867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.633008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.632895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-tmp-dir\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.633064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.633018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjgv\" (UniqueName: \"kubernetes.io/projected/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-kube-api-access-sdjgv\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.712217 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.712185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:43.734216 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9df9e62-7b30-46f5-937e-7629b918f504-cert\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.734377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v77b\" (UniqueName: \"kubernetes.io/projected/f9df9e62-7b30-46f5-937e-7629b918f504-kube-api-access-7v77b\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.734377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.734377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-tmp-dir\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.734377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjgv\" (UniqueName: \"kubernetes.io/projected/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-kube-api-access-sdjgv\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.734586 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:43.734433    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:43.734586 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:43.734505    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:44.234483132 +0000 UTC m=+35.652080260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:17:43.734701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-config-volume\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.734754 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.734740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-tmp-dir\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.735145 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.735121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-config-volume\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.739099 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.739078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9df9e62-7b30-46f5-937e-7629b918f504-cert\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.746087 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.746063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjgv\" (UniqueName: \"kubernetes.io/projected/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-kube-api-access-sdjgv\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:43.746192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.746167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v77b\" (UniqueName: \"kubernetes.io/projected/f9df9e62-7b30-46f5-937e-7629b918f504-kube-api-access-7v77b\") pod \"ingress-canary-lql8n\" (UID: \"f9df9e62-7b30-46f5-937e-7629b918f504\") " pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:43.819844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:43.819802    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lql8n"
Sep 09 17:17:44.046246 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.046170    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:17:44.046246 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.046188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:17:44.046246 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.046166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:17:44.048979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.048935    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 17:17:44.049095 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.048939    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kwqx\""
Sep 09 17:17:44.050013 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.049993    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 17:17:44.050150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.050127    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 17:17:44.050254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.050185    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 17:17:44.050254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.050185    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qln5f\""
Sep 09 17:17:44.238386 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:44.238354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:44.238684 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:44.238663    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:44.238778 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:44.238768    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:45.238747124 +0000 UTC m=+36.656344252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:17:45.247991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:45.247798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:45.247991 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:45.247980    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:45.248343 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:45.248048    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:47.248031148 +0000 UTC m=+38.665628275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:17:45.337915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:45.337842    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lql8n"]
Sep 09 17:17:45.362887 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:17:45.362862    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9df9e62_7b30_46f5_937e_7629b918f504.slice/crio-f907c7672aa0f4ad6969700882f4d238cd5cb04ff5cb2a59b0e88bd5bcfda181 WatchSource:0}: Error finding container f907c7672aa0f4ad6969700882f4d238cd5cb04ff5cb2a59b0e88bd5bcfda181: Status 404 returned error can't find the container with id f907c7672aa0f4ad6969700882f4d238cd5cb04ff5cb2a59b0e88bd5bcfda181
Sep 09 17:17:45.421599 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:45.421574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:45.473737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:45.473712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:46.276753 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:46.276707    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="22a1b60188908bff0ee64b9a69e027ae606f4acf5001dd84525c4638714e1409" exitCode=0
Sep 09 17:17:46.277424 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:46.276794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"22a1b60188908bff0ee64b9a69e027ae606f4acf5001dd84525c4638714e1409"}
Sep 09 17:17:46.278215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:46.278198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lql8n" event={"ID":"f9df9e62-7b30-46f5-937e-7629b918f504","Type":"ContainerStarted","Data":"f907c7672aa0f4ad6969700882f4d238cd5cb04ff5cb2a59b0e88bd5bcfda181"}
Sep 09 17:17:47.262869 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:47.262842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:47.263047 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:47.263027    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:47.263114 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:47.263103    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:51.263083404 +0000 UTC m=+42.680680533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:17:47.284785 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:47.284759    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6305232-c046-439f-91a5-8631ce940e6b" containerID="4edab5c0a676886f8683743f53130241c33b8598d3ee1b9d54a0760aae1d1690" exitCode=0
Sep 09 17:17:47.285243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:47.284794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerDied","Data":"4edab5c0a676886f8683743f53130241c33b8598d3ee1b9d54a0760aae1d1690"}
Sep 09 17:17:48.291452 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.291410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98rq7" event={"ID":"f6305232-c046-439f-91a5-8631ce940e6b","Type":"ContainerStarted","Data":"b34b79268f5a9b32fe3203f6144a3de1cf63a19cdb085074f6cf65c87ea46e2f"}
Sep 09 17:17:48.297036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.297015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:48.308889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.308847    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-98rq7" podStartSLOduration=9.617268275 podStartE2EDuration="39.308827814s" totalImagesPullingTime="29.691559539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:48.308650529 +0000 UTC m=+39.726247677" watchObservedRunningTime="2026-09-09 17:17:48.308827814 +0000 UTC m=+39.726424963"
Sep 09 17:17:48.399029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.398996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:48.498864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.498788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:48.551452 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:48.551426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:17:49.295504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:49.295468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lql8n" event={"ID":"f9df9e62-7b30-46f5-937e-7629b918f504","Type":"ContainerStarted","Data":"b0af1c6804bace4107b3e3918f4afec30d6045b2be3ede631edf0cef1d371b3a"}
Sep 09 17:17:49.311941 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:49.311899    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lql8n" podStartSLOduration=3.467460217 podStartE2EDuration="6.31188426s" totalImagesPullingTime="2.844424043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:17:49.310542553 +0000 UTC m=+40.728139705" watchObservedRunningTime="2026-09-09 17:17:49.31188426 +0000 UTC m=+40.729481409"
Sep 09 17:17:51.288006 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:51.287944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:51.288391 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:51.288101    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:51.288391 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:51.288178    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:17:59.288160879 +0000 UTC m=+50.705758011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:17:59.336551 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:17:59.336520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:17:59.336980 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:59.336667    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:17:59.336980 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:17:59.336730    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:18:15.336711727 +0000 UTC m=+66.754308853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:18:04.246364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:04.246331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:18:04.299028 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:04.299004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:18:07.515166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.515136    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"]
Sep 09 17:18:07.516818 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.516802    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.520386 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.520364    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 17:18:07.520501 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.520394    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 17:18:07.520501 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.520366    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 17:18:07.521039 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.521021    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 17:18:07.526675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.526654    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"]
Sep 09 17:18:07.593662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.593634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8446ccb2-297a-41fc-99f7-70e83765f8b0-tmp\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.593784 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.593675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8446ccb2-297a-41fc-99f7-70e83765f8b0-klusterlet-config\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.593784 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.593738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mcwl\" (UniqueName: \"kubernetes.io/projected/8446ccb2-297a-41fc-99f7-70e83765f8b0-kube-api-access-4mcwl\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.694995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.694954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mcwl\" (UniqueName: \"kubernetes.io/projected/8446ccb2-297a-41fc-99f7-70e83765f8b0-kube-api-access-4mcwl\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.695100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.695033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8446ccb2-297a-41fc-99f7-70e83765f8b0-tmp\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.695100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.695062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8446ccb2-297a-41fc-99f7-70e83765f8b0-klusterlet-config\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.695446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.695427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8446ccb2-297a-41fc-99f7-70e83765f8b0-tmp\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.698461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.698442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8446ccb2-297a-41fc-99f7-70e83765f8b0-klusterlet-config\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.703131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.703111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mcwl\" (UniqueName: \"kubernetes.io/projected/8446ccb2-297a-41fc-99f7-70e83765f8b0-kube-api-access-4mcwl\") pod \"klusterlet-addon-workmgr-579c5498f6-4tz67\" (UID: \"8446ccb2-297a-41fc-99f7-70e83765f8b0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:07.825695 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:07.825621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:08.093717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:08.093652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"]
Sep 09 17:18:08.097541 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:18:08.097509    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8446ccb2_297a_41fc_99f7_70e83765f8b0.slice/crio-1dd9132b11a8989d512524e7247bd8a88cddf111d01f8cf2078371188a97d12d WatchSource:0}: Error finding container 1dd9132b11a8989d512524e7247bd8a88cddf111d01f8cf2078371188a97d12d: Status 404 returned error can't find the container with id 1dd9132b11a8989d512524e7247bd8a88cddf111d01f8cf2078371188a97d12d
Sep 09 17:18:08.339110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:08.339078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" event={"ID":"8446ccb2-297a-41fc-99f7-70e83765f8b0","Type":"ContainerStarted","Data":"1dd9132b11a8989d512524e7247bd8a88cddf111d01f8cf2078371188a97d12d"}
Sep 09 17:18:09.261633 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:09.261605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vctmh"
Sep 09 17:18:09.364923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:09.364897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:18:09.415251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:09.415225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:18:09.466953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:09.466933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:18:14.739094 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.739049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:18:14.741558 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.741540    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 17:18:14.751660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.751628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72d0c9b2-8069-453f-b611-a25066960de5-original-pull-secret\") pod \"global-pull-secret-syncer-rtgmx\" (UID: \"72d0c9b2-8069-453f-b611-a25066960de5\") " pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:18:14.839601 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.839569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:18:14.839748 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.839607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:18:14.842115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.842099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 17:18:14.842162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.842119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 17:18:14.850017 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:14.849997    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 17:18:14.850061 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:14.850057    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:19:18.850041394 +0000 UTC m=+130.267638522 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : secret "metrics-daemon-secret" not found
Sep 09 17:18:14.851789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.851774    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 17:18:14.862838 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.862814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wz4\" (UniqueName: \"kubernetes.io/projected/41fb60e8-682c-4a8c-80a2-2ceb7c92e506-kube-api-access-k9wz4\") pod \"network-check-target-skxqw\" (UID: \"41fb60e8-682c-4a8c-80a2-2ceb7c92e506\") " pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:18:14.960479 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.960453    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qln5f\""
Sep 09 17:18:14.968339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.968318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:18:14.970573 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:14.970559    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtgmx"
Sep 09 17:18:15.257873 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:15.257796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-skxqw"]
Sep 09 17:18:15.261586 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:18:15.261562    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fb60e8_682c_4a8c_80a2_2ceb7c92e506.slice/crio-e5cce9d87c0504ef13f99dd4845e2ef8fc0b64c464a07257eb5b6bfd80f5324a WatchSource:0}: Error finding container e5cce9d87c0504ef13f99dd4845e2ef8fc0b64c464a07257eb5b6bfd80f5324a: Status 404 returned error can't find the container with id e5cce9d87c0504ef13f99dd4845e2ef8fc0b64c464a07257eb5b6bfd80f5324a
Sep 09 17:18:15.281918 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:15.281892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtgmx"]
Sep 09 17:18:15.284636 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:18:15.284609    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d0c9b2_8069_453f_b611_a25066960de5.slice/crio-9cf769181125e4c01f4c9794a336885c6421750f3a20f27a011922b05d99f461 WatchSource:0}: Error finding container 9cf769181125e4c01f4c9794a336885c6421750f3a20f27a011922b05d99f461: Status 404 returned error can't find the container with id 9cf769181125e4c01f4c9794a336885c6421750f3a20f27a011922b05d99f461
Sep 09 17:18:15.342350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:15.342314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:18:15.342476 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:15.342459    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:18:15.342530 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:15.342518    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:18:47.342503083 +0000 UTC m=+98.760100210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:18:15.356517 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:15.356486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtgmx" event={"ID":"72d0c9b2-8069-453f-b611-a25066960de5","Type":"ContainerStarted","Data":"9cf769181125e4c01f4c9794a336885c6421750f3a20f27a011922b05d99f461"}
Sep 09 17:18:15.357642 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:15.357622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-skxqw" event={"ID":"41fb60e8-682c-4a8c-80a2-2ceb7c92e506","Type":"ContainerStarted","Data":"e5cce9d87c0504ef13f99dd4845e2ef8fc0b64c464a07257eb5b6bfd80f5324a"}
Sep 09 17:18:20.375477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:20.375089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtgmx" event={"ID":"72d0c9b2-8069-453f-b611-a25066960de5","Type":"ContainerStarted","Data":"dc44bfd0599f54d7d3304fa2df1f5e29b1b44e3c60c7056b1f13791c07144033"}
Sep 09 17:18:20.378098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:20.378018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-skxqw" event={"ID":"41fb60e8-682c-4a8c-80a2-2ceb7c92e506","Type":"ContainerStarted","Data":"2320e61aeefdfff93d0c3c3e4c8c07f0f115ce01278017d473096221f698f0d8"}
Sep 09 17:18:20.378241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:20.378184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:18:20.389500 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:20.389427    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rtgmx" podStartSLOduration=66.444551286 podStartE2EDuration="1m11.389409654s" totalImagesPullingTime="4.944858368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:18:20.388669597 +0000 UTC m=+71.806266772" watchObservedRunningTime="2026-09-09 17:18:20.389409654 +0000 UTC m=+71.807006802"
Sep 09 17:18:20.402275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:20.402232    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-skxqw" podStartSLOduration=66.434614618 podStartE2EDuration="1m11.402216318s" totalImagesPullingTime="4.9676017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:18:20.401490664 +0000 UTC m=+71.819087806" watchObservedRunningTime="2026-09-09 17:18:20.402216318 +0000 UTC m=+71.819813467"
Sep 09 17:18:23.388292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:23.388252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" event={"ID":"8446ccb2-297a-41fc-99f7-70e83765f8b0","Type":"ContainerStarted","Data":"e7a69aaac80996f0ea7c9ee6a1118c23bf49a65b81ca6f46fc2f08babaea26c3"}
Sep 09 17:18:23.388663 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:23.388462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:23.389825 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:23.389797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:18:23.403012 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:23.402949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" podStartSLOduration=1.308844252 podStartE2EDuration="16.402937011s" totalImagesPullingTime="15.094092759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:18:23.401667773 +0000 UTC m=+74.819264913" watchObservedRunningTime="2026-09-09 17:18:23.402937011 +0000 UTC m=+74.820534159"
Sep 09 17:18:47.352980 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:47.352927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:18:47.353378 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:47.353072    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:18:47.353378 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:18:47.353145    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:19:51.35312956 +0000 UTC m=+162.770726687 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:18:51.383735 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:18:51.383701    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-skxqw"
Sep 09 17:19:18.857316 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:19:18.857268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:19:18.857735 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:18.857424    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 17:19:18.857735 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:18.857503    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs podName:53ec7a0d-1db6-4223-b93f-cd12cc19ba12 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:20.85748623 +0000 UTC m=+252.275083356 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs") pod "network-metrics-daemon-28drg" (UID: "53ec7a0d-1db6-4223-b93f-cd12cc19ba12") : secret "metrics-daemon-secret" not found
Sep 09 17:19:46.501597 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:46.501560    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v2ht2" podUID="3e4d10ae-4742-47b4-8ef9-e8150bc3acb7"
Sep 09 17:19:46.587615 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:19:46.587587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:19:47.065410 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:47.065369    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-28drg" podUID="53ec7a0d-1db6-4223-b93f-cd12cc19ba12"
Sep 09 17:19:51.367823 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:19:51.367782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:19:51.368236 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:51.367911    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 17:19:51.368236 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:19:51.367986    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls podName:3e4d10ae-4742-47b4-8ef9-e8150bc3acb7 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:53.367955821 +0000 UTC m=+284.785552947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls") pod "dns-default-v2ht2" (UID: "3e4d10ae-4742-47b4-8ef9-e8150bc3acb7") : secret "dns-default-metrics-tls" not found
Sep 09 17:19:59.047903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:19:59.047870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:20:21.500098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:21.500011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:23.389535 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:23.389492    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" podUID="8446ccb2-297a-41fc-99f7-70e83765f8b0" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Sep 09 17:20:23.673734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:23.673705    2559 generic.go:356] "Generic (PLEG): container finished" podID="8446ccb2-297a-41fc-99f7-70e83765f8b0" containerID="e7a69aaac80996f0ea7c9ee6a1118c23bf49a65b81ca6f46fc2f08babaea26c3" exitCode=1
Sep 09 17:20:23.673879 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:23.673756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" event={"ID":"8446ccb2-297a-41fc-99f7-70e83765f8b0","Type":"ContainerDied","Data":"e7a69aaac80996f0ea7c9ee6a1118c23bf49a65b81ca6f46fc2f08babaea26c3"}
Sep 09 17:20:23.674064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:23.674051    2559 scope.go:117] "RemoveContainer" containerID="e7a69aaac80996f0ea7c9ee6a1118c23bf49a65b81ca6f46fc2f08babaea26c3"
Sep 09 17:20:24.678826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:24.678792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67" event={"ID":"8446ccb2-297a-41fc-99f7-70e83765f8b0","Type":"ContainerStarted","Data":"01268ef14a5ec0c47f364d9c14210f0568d0b6ba514e924870d34e56c20850b4"}
Sep 09 17:20:24.679195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:24.679119    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:20:24.679686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:24.679669    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-579c5498f6-4tz67"
Sep 09 17:20:28.646227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:28.646194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:52.981703 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.981671    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"]
Sep 09 17:20:52.983415 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.983399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"
Sep 09 17:20:52.986222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.986198    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 17:20:52.986370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.986242    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vcl9q\""
Sep 09 17:20:52.987090 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.987071    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 17:20:52.988205 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.988186    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65d6dd55f6-6pkr7"]
Sep 09 17:20:52.990574 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.990560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:52.994118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.994101    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 17:20:52.994631 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.994618    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 17:20:52.994891 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.994875    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 17:20:52.994933 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.994877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 17:20:52.994933 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.994910    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 17:20:52.995220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.995206    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rhmhj\""
Sep 09 17:20:52.995643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.995622    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 17:20:52.997630 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:52.997612    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"]
Sep 09 17:20:53.009345 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.009324    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d6dd55f6-6pkr7"]
Sep 09 17:20:53.061451 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p89tj\" (UniqueName: \"kubernetes.io/projected/f1339756-f221-4ea8-bdac-1b91b3a34461-kube-api-access-p89tj\") pod \"volume-data-source-validator-695c895bd6-g5jrv\" (UID: \"f1339756-f221-4ea8-bdac-1b91b3a34461\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"
Sep 09 17:20:53.061596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.061596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssbfk\" (UniqueName: \"kubernetes.io/projected/364f5751-5f64-4334-b85a-37e12355d575-kube-api-access-ssbfk\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.061596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-default-certificate\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.061596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-stats-auth\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.061751 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.061609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.081637 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.081607    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p5qz2"]
Sep 09 17:20:53.084009 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.083993    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:20:53.084135 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.084122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.085926 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.085909    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.087570 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.087552    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 17:20:53.087660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.087581    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 17:20:53.087716 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.087704    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 17:20:53.088068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088050    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 17:20:53.088140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088089    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 17:20:53.088413 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rptzt\""
Sep 09 17:20:53.088462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088434    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kdgth\""
Sep 09 17:20:53.088507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088440    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 17:20:53.088755 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.088735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 17:20:53.095770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.095752    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 17:20:53.095850 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.095777    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 17:20:53.098719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.098703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p5qz2"]
Sep 09 17:20:53.099757 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.099738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:20:53.162156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.162156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-snapshots\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-stats-auth\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.162306 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.162276    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:20:53.162397 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162397 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.162342    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:53.662322814 +0000 UTC m=+225.079919947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:20:53.162397 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162493 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np476\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162493 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fc45dc0-c198-4be0-861f-b06b2c194d90-serving-cert\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162493 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xng9\" (UniqueName: \"kubernetes.io/projected/3fc45dc0-c198-4be0-861f-b06b2c194d90-kube-api-access-8xng9\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162593 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p89tj\" (UniqueName: \"kubernetes.io/projected/f1339756-f221-4ea8-bdac-1b91b3a34461-kube-api-access-p89tj\") pod \"volume-data-source-validator-695c895bd6-g5jrv\" (UID: \"f1339756-f221-4ea8-bdac-1b91b3a34461\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"
Sep 09 17:20:53.162593 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssbfk\" (UniqueName: \"kubernetes.io/projected/364f5751-5f64-4334-b85a-37e12355d575-kube-api-access-ssbfk\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.162593 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-default-certificate\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.162765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.162987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-tmp\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.162987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.162987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.162933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.163182 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.163067    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:53.66305038 +0000 UTC m=+225.080647508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:20:53.164879 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.164859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-stats-auth\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.165207 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.165188    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-default-certificate\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.170410 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.170389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p89tj\" (UniqueName: \"kubernetes.io/projected/f1339756-f221-4ea8-bdac-1b91b3a34461-kube-api-access-p89tj\") pod \"volume-data-source-validator-695c895bd6-g5jrv\" (UID: \"f1339756-f221-4ea8-bdac-1b91b3a34461\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"
Sep 09 17:20:53.170982 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.170937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssbfk\" (UniqueName: \"kubernetes.io/projected/364f5751-5f64-4334-b85a-37e12355d575-kube-api-access-ssbfk\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.179882 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.179862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fw265"]
Sep 09 17:20:53.181846 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.181830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.184655 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.184638    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 17:20:53.184865 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.184847    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 17:20:53.184947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.184885    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cdrmn\""
Sep 09 17:20:53.190507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.190486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fw265"]
Sep 09 17:20:53.220256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.220235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:53.264068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264221 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.264221 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np476\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264221 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.264158    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 17:20:53.264221 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.264174    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b6bfc5fd-gjkdz: secret "image-registry-tls" not found
Sep 09 17:20:53.264221 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fc45dc0-c198-4be0-861f-b06b2c194d90-serving-cert\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.264458 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.264252    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls podName:f583bf57-4fde-4117-8f5b-894afb80a812 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:53.764207109 +0000 UTC m=+225.181804241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls") pod "image-registry-9b6bfc5fd-gjkdz" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812") : secret "image-registry-tls" not found
Sep 09 17:20:53.264458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xng9\" (UniqueName: \"kubernetes.io/projected/3fc45dc0-c198-4be0-861f-b06b2c194d90-kube-api-access-8xng9\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.264458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.264714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-tmp\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.264714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.264910 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.265034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.265215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-tmp\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.265293 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.264712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.265293 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-snapshots\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.265400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1bc9880-e88e-489e-b031-4ee1a3c663fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.265400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.265466 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc45dc0-c198-4be0-861f-b06b2c194d90-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.265995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.265953    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3fc45dc0-c198-4be0-861f-b06b2c194d90-snapshots\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.266088 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.266068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.266616 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.266598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.266859 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.266840    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.266913 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.266872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fc45dc0-c198-4be0-861f-b06b2c194d90-serving-cert\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.274040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.274011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xng9\" (UniqueName: \"kubernetes.io/projected/3fc45dc0-c198-4be0-861f-b06b2c194d90-kube-api-access-8xng9\") pod \"insights-operator-76bcd6ccf5-p5qz2\" (UID: \"3fc45dc0-c198-4be0-861f-b06b2c194d90\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.274126 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.274091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np476\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.274538 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.274518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.276303 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.276270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:53.292188 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.292169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"
Sep 09 17:20:53.366637 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.366607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.366790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.366643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1bc9880-e88e-489e-b031-4ee1a3c663fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.366790 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.366775    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:20:53.366901 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.366857    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:20:53.866835562 +0000 UTC m=+225.284432707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:20:53.367277 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.367258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1bc9880-e88e-489e-b031-4ee1a3c663fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.393545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.393526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2"
Sep 09 17:20:53.553481 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.553418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv"]
Sep 09 17:20:53.556340 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:20:53.556317    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1339756_f221_4ea8_bdac_1b91b3a34461.slice/crio-257a138e929e055f4c6c78d80cd3d5edd66342e5eec83cebec79db815cc2bb3e WatchSource:0}: Error finding container 257a138e929e055f4c6c78d80cd3d5edd66342e5eec83cebec79db815cc2bb3e: Status 404 returned error can't find the container with id 257a138e929e055f4c6c78d80cd3d5edd66342e5eec83cebec79db815cc2bb3e
Sep 09 17:20:53.656506 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.656479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p5qz2"]
Sep 09 17:20:53.660606 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:20:53.660583    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc45dc0_c198_4be0_861f_b06b2c194d90.slice/crio-f2cda7f7c1e87ae3a200d420de2001b29b0a7f13f0bdfce5263d9665e356f812 WatchSource:0}: Error finding container f2cda7f7c1e87ae3a200d420de2001b29b0a7f13f0bdfce5263d9665e356f812: Status 404 returned error can't find the container with id f2cda7f7c1e87ae3a200d420de2001b29b0a7f13f0bdfce5263d9665e356f812
Sep 09 17:20:53.669850 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.669823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.669956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.669943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:53.670053 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.669954    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:20:53.670053 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.670019    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:54.670003367 +0000 UTC m=+226.087600494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:20:53.670155 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.670112    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:54.670095425 +0000 UTC m=+226.087692565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:20:53.763540 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.763507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2" event={"ID":"3fc45dc0-c198-4be0-861f-b06b2c194d90","Type":"ContainerStarted","Data":"f2cda7f7c1e87ae3a200d420de2001b29b0a7f13f0bdfce5263d9665e356f812"}
Sep 09 17:20:53.764590 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.764570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv" event={"ID":"f1339756-f221-4ea8-bdac-1b91b3a34461","Type":"ContainerStarted","Data":"257a138e929e055f4c6c78d80cd3d5edd66342e5eec83cebec79db815cc2bb3e"}
Sep 09 17:20:53.770935 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.770915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:53.771083 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.771065    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 17:20:53.771146 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.771086    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b6bfc5fd-gjkdz: secret "image-registry-tls" not found
Sep 09 17:20:53.771201 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.771158    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls podName:f583bf57-4fde-4117-8f5b-894afb80a812 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:54.771139024 +0000 UTC m=+226.188736166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls") pod "image-registry-9b6bfc5fd-gjkdz" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812") : secret "image-registry-tls" not found
Sep 09 17:20:53.871652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:53.871573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:53.871774 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.871685    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:20:53.871774 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:53.871743    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:20:54.871730114 +0000 UTC m=+226.289327242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:20:54.679141 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.679112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:54.679484 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.679237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:54.679484 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.679286    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:20:54.679484 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.679348    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:56.67932986 +0000 UTC m=+228.096927008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:20:54.679484 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.679384    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:56.679366829 +0000 UTC m=+228.096963975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:20:54.768979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.768939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv" event={"ID":"f1339756-f221-4ea8-bdac-1b91b3a34461","Type":"ContainerStarted","Data":"fea7bf7c154a1edf4508f55dedd4bc208077b6be7f8946ff27770d423629e30e"}
Sep 09 17:20:54.780261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.780241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:54.780366 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.780354    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 17:20:54.780398 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.780371    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b6bfc5fd-gjkdz: secret "image-registry-tls" not found
Sep 09 17:20:54.780433 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.780417    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls podName:f583bf57-4fde-4117-8f5b-894afb80a812 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:56.780403577 +0000 UTC m=+228.198000705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls") pod "image-registry-9b6bfc5fd-gjkdz" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812") : secret "image-registry-tls" not found
Sep 09 17:20:54.782052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.782012    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g5jrv" podStartSLOduration=1.676811279 podStartE2EDuration="2.781998718s" totalImagesPullingTime="1.105187439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:20:54.781476952 +0000 UTC m=+226.199074100" watchObservedRunningTime="2026-09-09 17:20:54.781998718 +0000 UTC m=+226.199595864"
Sep 09 17:20:54.843595 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.843561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:54.881629 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:54.881599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:54.881778 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.881763    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:20:54.881838 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:54.881828    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:20:56.881812226 +0000 UTC m=+228.299409377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:20:55.773948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:55.773859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2" event={"ID":"3fc45dc0-c198-4be0-861f-b06b2c194d90","Type":"ContainerStarted","Data":"a93894bb48587db92f2d8677e88a8c9c8c39bf345bf77772fe67c0014d965598"}
Sep 09 17:20:56.579222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.579170    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2" podStartSLOduration=1.7653194540000001 podStartE2EDuration="3.579152699s" totalImagesPullingTime="1.813833245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:20:55.789244803 +0000 UTC m=+227.206841954" watchObservedRunningTime="2026-09-09 17:20:56.579152699 +0000 UTC m=+227.996749847"
Sep 09 17:20:56.579765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.579751    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qrqbl"]
Sep 09 17:20:56.582219 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.582204    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.586853 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.586828    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 17:20:56.587168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.587147    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wvqv8\""
Sep 09 17:20:56.587399 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.587384    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 17:20:56.595597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.595577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrqbl"]
Sep 09 17:20:56.600405 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.600360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:56.664404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.664368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:56.695454 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:56.695543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.695543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-crio-socket\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.695543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.695678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-data-volume\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.695678 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.695564    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:20:56.695678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hwc8\" (UniqueName: \"kubernetes.io/projected/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-api-access-5hwc8\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.695678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.695598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:20:56.695678 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.695629    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.695611108 +0000 UTC m=+232.113208238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:20:56.695842 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.695682    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.695667684 +0000 UTC m=+232.113264811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:20:56.796087 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-crio-socket\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796117    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-data-volume\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hwc8\" (UniqueName: \"kubernetes.io/projected/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-api-access-5hwc8\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-crio-socket\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796205    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796212    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796263    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:57.296246813 +0000 UTC m=+228.713843944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : configmap "kube-rbac-proxy" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796279    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:57.29627207 +0000 UTC m=+228.713869197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796409    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796418    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b6bfc5fd-gjkdz: secret "image-registry-tls" not found
Sep 09 17:20:56.796470 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.796446    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls podName:f583bf57-4fde-4117-8f5b-894afb80a812 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.796439011 +0000 UTC m=+232.214036143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls") pod "image-registry-9b6bfc5fd-gjkdz" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812") : secret "image-registry-tls" not found
Sep 09 17:20:56.796921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.796490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-data-volume\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.805871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.805848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hwc8\" (UniqueName: \"kubernetes.io/projected/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-api-access-5hwc8\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:56.896832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:56.896757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:20:56.896953 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.896839    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:20:56.896953 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:56.896903    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.896884419 +0000 UTC m=+232.314481548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:20:57.300236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:57.300197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:57.300236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:57.300238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:57.300440 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:57.300312    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 17:20:57.300440 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:57.300348    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:57.300440 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:57.300364    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:58.300344795 +0000 UTC m=+229.717941924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : configmap "kube-rbac-proxy" not found
Sep 09 17:20:57.300440 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:57.300398    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:20:58.300385248 +0000 UTC m=+229.717982381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:57.904988 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:57.904943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:58.005048 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.005007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:58.101561 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.101522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:58.200677 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.200644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:58.307796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.307751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:58.308022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.307810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:20:58.308022 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:58.307899    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:58.308022 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:58.307927    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 17:20:58.308022 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:58.307976    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.307944411 +0000 UTC m=+231.725541542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : secret "insights-runtime-extractor-tls" not found
Sep 09 17:20:58.308022 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:20:58.308013    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:00.307995413 +0000 UTC m=+231.725592540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : configmap "kube-rbac-proxy" not found
Sep 09 17:20:58.536446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.536361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvkwc_193c1ede-f459-4d14-b891-065933f64baf/dns-node-resolver/0.log"
Sep 09 17:20:58.808363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.808273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:58.858529 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:58.858476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:20:59.736374 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:59.736348    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ws7cp_28e7e799-a82e-4bc3-b751-82b3701b04af/node-ca/0.log"
Sep 09 17:20:59.923144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:20:59.923105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:00.023359 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.023259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:00.323591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.323519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:00.323591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.323560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:00.323764 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.323661    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 17:21:00.323764 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.323667    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 17:21:00.323764 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.323730    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:04.323710589 +0000 UTC m=+235.741307719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : secret "insights-runtime-extractor-tls" not found
Sep 09 17:21:00.323764 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.323745    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:04.323738237 +0000 UTC m=+235.741335364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : configmap "kube-rbac-proxy" not found
Sep 09 17:21:00.336985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.336951    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lql8n_f9df9e62-7b30-46f5-937e-7629b918f504/serve-healthcheck-canary/0.log"
Sep 09 17:21:00.402399 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.402372    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4k7nl"]
Sep 09 17:21:00.404296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.404281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.406516 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.406496    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 17:21:00.406845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.406825    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 17:21:00.406927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.406827    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 17:21:00.406927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.406877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 17:21:00.408036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.408020    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bcjtm\""
Sep 09 17:21:00.412025 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.412006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4k7nl"]
Sep 09 17:21:00.438128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.438102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:00.488896 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.488878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:00.525080 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.525058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-key\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.525180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.525094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbgbg\" (UniqueName: \"kubernetes.io/projected/4b7a49f6-c545-40ea-87ad-c83545d69e97-kube-api-access-pbgbg\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.525180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.525134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-cabundle\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.626392 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.626337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-key\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.626392 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.626363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbgbg\" (UniqueName: \"kubernetes.io/projected/4b7a49f6-c545-40ea-87ad-c83545d69e97-kube-api-access-pbgbg\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.626392 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.626393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-cabundle\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.627099 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.627083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-cabundle\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.628843 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.628822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b7a49f6-c545-40ea-87ad-c83545d69e97-signing-key\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.634537 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.634515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbgbg\" (UniqueName: \"kubernetes.io/projected/4b7a49f6-c545-40ea-87ad-c83545d69e97-kube-api-access-pbgbg\") pod \"service-ca-75d99c484-4k7nl\" (UID: \"4b7a49f6-c545-40ea-87ad-c83545d69e97\") " pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.713466 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.713448    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4k7nl"
Sep 09 17:21:00.727916 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.727893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:00.728021 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.727936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:00.728082 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.728069    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:08.728050514 +0000 UTC m=+240.145647642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:21:00.728139 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.728077    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:21:00.728139 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.728115    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:08.728103378 +0000 UTC m=+240.145700507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:21:00.828871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.828837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:00.829240 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.829003    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 17:21:00.829240 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.829019    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b6bfc5fd-gjkdz: secret "image-registry-tls" not found
Sep 09 17:21:00.829240 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.829081    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls podName:f583bf57-4fde-4117-8f5b-894afb80a812 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:08.829064878 +0000 UTC m=+240.246662004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls") pod "image-registry-9b6bfc5fd-gjkdz" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812") : secret "image-registry-tls" not found
Sep 09 17:21:00.929828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.929799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:21:00.929974 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.929931    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:21:00.930029 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:00.930012    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:21:08.929996557 +0000 UTC m=+240.347593684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:21:00.979212 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:00.979184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4k7nl"]
Sep 09 17:21:00.982038 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:00.982017    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7a49f6_c545_40ea_87ad_c83545d69e97.slice/crio-ea45a15e3493f8937b1eb5200ec535bfa954338ef866486d0da3d2cad89d2fab WatchSource:0}: Error finding container ea45a15e3493f8937b1eb5200ec535bfa954338ef866486d0da3d2cad89d2fab: Status 404 returned error can't find the container with id ea45a15e3493f8937b1eb5200ec535bfa954338ef866486d0da3d2cad89d2fab
Sep 09 17:21:01.329789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:01.329701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:01.462219 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:01.462181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:01.792032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:01.791995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4k7nl" event={"ID":"4b7a49f6-c545-40ea-87ad-c83545d69e97","Type":"ContainerStarted","Data":"ea45a15e3493f8937b1eb5200ec535bfa954338ef866486d0da3d2cad89d2fab"}
Sep 09 17:21:03.800525 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:03.800483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4k7nl" event={"ID":"4b7a49f6-c545-40ea-87ad-c83545d69e97","Type":"ContainerStarted","Data":"ec0b261e81b03037f0e89a2dc20c6f920b853c9c5b01eb15463336ab25ea865f"}
Sep 09 17:21:03.816723 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:03.816672    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-4k7nl" podStartSLOduration=1.84432401 podStartE2EDuration="3.816653535s" totalImagesPullingTime="1.972329525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:03.81558487 +0000 UTC m=+235.233182030" watchObservedRunningTime="2026-09-09 17:21:03.816653535 +0000 UTC m=+235.234250681"
Sep 09 17:21:03.831395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:03.831372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:04.359859 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:04.359829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:04.360048 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:04.359868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:04.360048 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:04.360000    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 17:21:04.360126 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:04.360065    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls podName:f74c1d6d-7ccd-49b6-a09d-5062fcc71912 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:12.360048451 +0000 UTC m=+243.777645583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrqbl" (UID: "f74c1d6d-7ccd-49b6-a09d-5062fcc71912") : secret "insights-runtime-extractor-tls" not found
Sep 09 17:21:04.360524 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:04.360505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:05.104282 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.104238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.202074 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.201995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.301790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.301713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.406686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.406588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.506875 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.506838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.607245 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.607207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.748310 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.748281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:05.940256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:05.940226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:07.144685 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:07.144651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:07.350138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:07.350106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:07.548146 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:07.548103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:07.741198 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:07.741168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:07.944975 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:07.944925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:08.208800 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.208712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:08.736710 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.736661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:08.794922 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.794888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:08.795100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.795032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:08.795100 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:08.795049    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 17:21:08.795232 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:08.795102    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:24.795087647 +0000 UTC m=+256.212684774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : secret "router-metrics-certs-default" not found
Sep 09 17:21:08.795232 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:08.795177    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle podName:364f5751-5f64-4334-b85a-37e12355d575 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:24.795160706 +0000 UTC m=+256.212757852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle") pod "router-default-65d6dd55f6-6pkr7" (UID: "364f5751-5f64-4334-b85a-37e12355d575") : configmap references non-existent config key: service-ca.crt
Sep 09 17:21:08.797431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.797390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:08.895595 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.895541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:08.898046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.898019    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"image-registry-9b6bfc5fd-gjkdz\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") " pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:08.996612 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:08.996540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:21:08.996739 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:08.996660    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 17:21:08.996739 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:08.996708    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert podName:a1bc9880-e88e-489e-b031-4ee1a3c663fd nodeName:}" failed. No retries permitted until 2026-09-09 17:21:24.996693967 +0000 UTC m=+256.414291093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fw265" (UID: "a1bc9880-e88e-489e-b031-4ee1a3c663fd") : secret "networking-console-plugin-cert" not found
Sep 09 17:21:09.001881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.001864    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kdgth\""
Sep 09 17:21:09.009956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.009935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:09.158259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.158229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:09.282399 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.282327    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:21:09.285241 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:09.285204    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf583bf57_4fde_4117_8f5b_894afb80a812.slice/crio-e573b96e6380884f2fbb520d84a61739407a8e3eb8e2a7c0dc799dfce169ef46 WatchSource:0}: Error finding container e573b96e6380884f2fbb520d84a61739407a8e3eb8e2a7c0dc799dfce169ef46: Status 404 returned error can't find the container with id e573b96e6380884f2fbb520d84a61739407a8e3eb8e2a7c0dc799dfce169ef46
Sep 09 17:21:09.340071 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.340029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:09.543764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.543674    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:09.820742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.820660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" event={"ID":"f583bf57-4fde-4117-8f5b-894afb80a812","Type":"ContainerStarted","Data":"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"}
Sep 09 17:21:09.820742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.820711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" event={"ID":"f583bf57-4fde-4117-8f5b-894afb80a812","Type":"ContainerStarted","Data":"e573b96e6380884f2fbb520d84a61739407a8e3eb8e2a7c0dc799dfce169ef46"}
Sep 09 17:21:09.820742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.820735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:09.837539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.837487    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" podStartSLOduration=16.837468945 podStartE2EDuration="16.837468945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:09.837109789 +0000 UTC m=+241.254706966" watchObservedRunningTime="2026-09-09 17:21:09.837468945 +0000 UTC m=+241.255066094"
Sep 09 17:21:09.940980 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:09.940935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:10.139265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:10.139175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:10.537657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:10.537627    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:11.161225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:11.161194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:11.752503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:11.752471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:11.807672 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:11.807643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:11.941598 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:11.941542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:12.136763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.136675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:12.421204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.421179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:12.423540 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.423512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f74c1d6d-7ccd-49b6-a09d-5062fcc71912-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrqbl\" (UID: \"f74c1d6d-7ccd-49b6-a09d-5062fcc71912\") " pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:12.493468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.493443    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wvqv8\""
Sep 09 17:21:12.501522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.501498    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrqbl"
Sep 09 17:21:12.540730 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.540698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:12.779083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.779014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrqbl"]
Sep 09 17:21:12.831504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:12.831480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrqbl" event={"ID":"f74c1d6d-7ccd-49b6-a09d-5062fcc71912","Type":"ContainerStarted","Data":"e6873932102bf21817d45984f8abb661dd0a71514fdb5d6b8d98cb7f7ed4a21f"}
Sep 09 17:21:13.142192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:13.142108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:13.539284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:13.539260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:13.838643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:13.838560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrqbl" event={"ID":"f74c1d6d-7ccd-49b6-a09d-5062fcc71912","Type":"ContainerStarted","Data":"e43eba13a75ce2378ae8698ca6bbb1e3e05d77c0e902194a2f4b5496a85154d8"}
Sep 09 17:21:13.838643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:13.838632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrqbl" event={"ID":"f74c1d6d-7ccd-49b6-a09d-5062fcc71912","Type":"ContainerStarted","Data":"d8de30b642c263e3ef81eb13d4784431fce4e00ea630dab3867b69a5bd6358db"}
Sep 09 17:21:13.941564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:13.941520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:14.465292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:14.465255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:14.565877 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:14.565844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:14.736818 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:14.736724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:15.536316 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:15.536288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:15.739921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:15.739889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:15.846955 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:15.846877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrqbl" event={"ID":"f74c1d6d-7ccd-49b6-a09d-5062fcc71912","Type":"ContainerStarted","Data":"ccf5e6a7025f06da9f1e34ee5b01d39675bef28333571ae63ad3ba4a4c313bc9"}
Sep 09 17:21:15.865341 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:15.865301    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qrqbl" podStartSLOduration=17.807983589 podStartE2EDuration="19.865286667s" totalImagesPullingTime="2.057303078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:20:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:15.863736099 +0000 UTC m=+247.281333250" watchObservedRunningTime="2026-09-09 17:21:15.865286667 +0000 UTC m=+247.282883816"
Sep 09 17:21:15.941850 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:15.941815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:19.502935 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.502899    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:21:19.509758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.509732    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5748c46786-p68wg"]
Sep 09 17:21:19.512834 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.512814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.526163 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.526140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5748c46786-p68wg"]
Sep 09 17:21:19.604263 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.604235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:19.675055 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-bound-sa-token\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d465801e-f07c-4a37-b78e-523691aa6973-ca-trust-extracted\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-image-registry-private-configuration\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-trusted-ca\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-registry-tls\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-registry-certificates\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675361 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqm56\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-kube-api-access-qqm56\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.675361 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.675337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-installation-pull-secrets\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.697589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.697555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:19.775791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.775732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-bound-sa-token\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.775791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.775760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d465801e-f07c-4a37-b78e-523691aa6973-ca-trust-extracted\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.775791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.775778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-image-registry-private-configuration\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776018 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.775793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-trusted-ca\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776078 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-registry-tls\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-registry-certificates\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqm56\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-kube-api-access-qqm56\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-installation-pull-secrets\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d465801e-f07c-4a37-b78e-523691aa6973-ca-trust-extracted\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.776740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.776718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-trusted-ca\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.777288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.777266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d465801e-f07c-4a37-b78e-523691aa6973-registry-certificates\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.778453 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.778431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-installation-pull-secrets\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.778615 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.778598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-registry-tls\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.778676 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.778629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d465801e-f07c-4a37-b78e-523691aa6973-image-registry-private-configuration\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.798741 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.798716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-bound-sa-token\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.799916 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.799898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqm56\" (UniqueName: \"kubernetes.io/projected/d465801e-f07c-4a37-b78e-523691aa6973-kube-api-access-qqm56\") pod \"image-registry-5748c46786-p68wg\" (UID: \"d465801e-f07c-4a37-b78e-523691aa6973\") " pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.820863 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.820846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:19.858751 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:19.858686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.087076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.086994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.096015 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.095987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5748c46786-p68wg"]
Sep 09 17:21:20.098887 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:20.098860    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd465801e_f07c_4a37_b78e_523691aa6973.slice/crio-22e57dd9cad12c442958bb7c1353d24d52c80a17580c1ad407781347bbd7315e WatchSource:0}: Error finding container 22e57dd9cad12c442958bb7c1353d24d52c80a17580c1ad407781347bbd7315e: Status 404 returned error can't find the container with id 22e57dd9cad12c442958bb7c1353d24d52c80a17580c1ad407781347bbd7315e
Sep 09 17:21:20.138061 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.138029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.239603 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.239574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.380718 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.380624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.745460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.745422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.863752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.863722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5748c46786-p68wg" event={"ID":"d465801e-f07c-4a37-b78e-523691aa6973","Type":"ContainerStarted","Data":"d05a2be4c2d7965d2e36a7dac6595885203e45ea758da93aa40eb2c4fc88b08e"}
Sep 09 17:21:20.863915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.863767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5748c46786-p68wg" event={"ID":"d465801e-f07c-4a37-b78e-523691aa6973","Type":"ContainerStarted","Data":"22e57dd9cad12c442958bb7c1353d24d52c80a17580c1ad407781347bbd7315e"}
Sep 09 17:21:20.863915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.863839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:20.865142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.865118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:20.885371 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.885339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:21:20.886279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.886243    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podStartSLOduration=1.8862315139999999 podStartE2EDuration="1.886231514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:20.885323161 +0000 UTC m=+252.302920309" watchObservedRunningTime="2026-09-09 17:21:20.886231514 +0000 UTC m=+252.303828660"
Sep 09 17:21:20.887864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.887848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53ec7a0d-1db6-4223-b93f-cd12cc19ba12-metrics-certs\") pod \"network-metrics-daemon-28drg\" (UID: \"53ec7a0d-1db6-4223-b93f-cd12cc19ba12\") " pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:21:20.950484 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.950464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kwqx\""
Sep 09 17:21:20.958668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.958655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28drg"
Sep 09 17:21:20.987372 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:20.987342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.070342 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.070318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.227252 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.227224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28drg"]
Sep 09 17:21:21.229879 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:21.229855    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ec7a0d_1db6_4223_b93f_cd12cc19ba12.slice/crio-5472a946880f5820f1cc76e72940aff04911c1c02b002f70b5d84268dc68f6d3 WatchSource:0}: Error finding container 5472a946880f5820f1cc76e72940aff04911c1c02b002f70b5d84268dc68f6d3: Status 404 returned error can't find the container with id 5472a946880f5820f1cc76e72940aff04911c1c02b002f70b5d84268dc68f6d3
Sep 09 17:21:21.254922 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.254886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.308461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.308390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.599475 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.599392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.768761 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.768726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:21.869029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.868928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28drg" event={"ID":"53ec7a0d-1db6-4223-b93f-cd12cc19ba12","Type":"ContainerStarted","Data":"5472a946880f5820f1cc76e72940aff04911c1c02b002f70b5d84268dc68f6d3"}
Sep 09 17:21:21.966423 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:21.966368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:22.083261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:22.083223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:22.878336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:22.878298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28drg" event={"ID":"53ec7a0d-1db6-4223-b93f-cd12cc19ba12","Type":"ContainerStarted","Data":"20fe90a55cc541b5d6b4fa7ae5fb7962d5a391df80796ad7e58632af82267ce6"}
Sep 09 17:21:22.878716 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:22.878394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28drg" event={"ID":"53ec7a0d-1db6-4223-b93f-cd12cc19ba12","Type":"ContainerStarted","Data":"307d578325195f8fc46e3b8b8735ae2c60dfe7e03b222c83bdef93feccd5148d"}
Sep 09 17:21:22.895803 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:22.895756    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-28drg" podStartSLOduration=252.979783666 podStartE2EDuration="4m13.895743082s" totalImagesPullingTime="915.959416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:22.895190902 +0000 UTC m=+254.312788050" watchObservedRunningTime="2026-09-09 17:21:22.895743082 +0000 UTC m=+254.313340231"
Sep 09 17:21:22.981539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:22.981504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:23.044915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:23.044877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:23.372762 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:23.372729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:23.437085 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:23.437055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:24.817218 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:24.817170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:24.817684 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:24.817288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:24.817909 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:24.817891    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/364f5751-5f64-4334-b85a-37e12355d575-service-ca-bundle\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:24.819678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:24.819662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/364f5751-5f64-4334-b85a-37e12355d575-metrics-certs\") pod \"router-default-65d6dd55f6-6pkr7\" (UID: \"364f5751-5f64-4334-b85a-37e12355d575\") " pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:25.019098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.019059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:21:25.021549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.021528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1bc9880-e88e-489e-b031-4ee1a3c663fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fw265\" (UID: \"a1bc9880-e88e-489e-b031-4ee1a3c663fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:21:25.101240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.101166    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rhmhj\""
Sep 09 17:21:25.110004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.109977    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:25.292639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.292615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cdrmn\""
Sep 09 17:21:25.300638 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.300620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fw265"
Sep 09 17:21:25.379659 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.379595    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d6dd55f6-6pkr7"]
Sep 09 17:21:25.382238 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:25.382217    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364f5751_5f64_4334_b85a_37e12355d575.slice/crio-89d3dcec2f0546148c74b47075d2a716aa6999134ab9bfd0697fb1d1cc2ce0b7 WatchSource:0}: Error finding container 89d3dcec2f0546148c74b47075d2a716aa6999134ab9bfd0697fb1d1cc2ce0b7: Status 404 returned error can't find the container with id 89d3dcec2f0546148c74b47075d2a716aa6999134ab9bfd0697fb1d1cc2ce0b7
Sep 09 17:21:25.567912 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.567880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fw265"]
Sep 09 17:21:25.570641 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:25.570615    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bc9880_e88e_489e_b031_4ee1a3c663fd.slice/crio-2ad64721e2371a28593afac8d5a411c406d5c9fb0fd9d2f8216276d11e0b635d WatchSource:0}: Error finding container 2ad64721e2371a28593afac8d5a411c406d5c9fb0fd9d2f8216276d11e0b635d: Status 404 returned error can't find the container with id 2ad64721e2371a28593afac8d5a411c406d5c9fb0fd9d2f8216276d11e0b635d
Sep 09 17:21:25.890446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.890411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fw265" event={"ID":"a1bc9880-e88e-489e-b031-4ee1a3c663fd","Type":"ContainerStarted","Data":"2ad64721e2371a28593afac8d5a411c406d5c9fb0fd9d2f8216276d11e0b635d"}
Sep 09 17:21:25.891747 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.891726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7" event={"ID":"364f5751-5f64-4334-b85a-37e12355d575","Type":"ContainerStarted","Data":"3d37dc98b815f3d334f3ae70712d5b09dc5058da188c3d57e52a4fe4b6887325"}
Sep 09 17:21:25.891817 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.891763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7" event={"ID":"364f5751-5f64-4334-b85a-37e12355d575","Type":"ContainerStarted","Data":"89d3dcec2f0546148c74b47075d2a716aa6999134ab9bfd0697fb1d1cc2ce0b7"}
Sep 09 17:21:25.913788 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:25.913748    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7" podStartSLOduration=33.913736469 podStartE2EDuration="33.913736469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:25.911927839 +0000 UTC m=+257.329524999" watchObservedRunningTime="2026-09-09 17:21:25.913736469 +0000 UTC m=+257.331333618"
Sep 09 17:21:26.111046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.111013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:26.113470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.113448    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:26.896786 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.896745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fw265" event={"ID":"a1bc9880-e88e-489e-b031-4ee1a3c663fd","Type":"ContainerStarted","Data":"60f93825e1f46de29453842c87943733a78a607be92c395b889619c249dfdd30"}
Sep 09 17:21:26.897207 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.896974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:26.898175 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.898159    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65d6dd55f6-6pkr7"
Sep 09 17:21:26.912372 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:26.912334    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-fw265" podStartSLOduration=32.742690841 podStartE2EDuration="33.912322716s" totalImagesPullingTime="1.169631875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:26.910640325 +0000 UTC m=+258.328237473" watchObservedRunningTime="2026-09-09 17:21:26.912322716 +0000 UTC m=+258.329919865"
Sep 09 17:21:27.006527 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:27.006446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:27.078744 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:27.078712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:27.754042 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:27.754015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:27.947068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:27.947037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:28.402033 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:28.402005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:29.508335 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:29.508303    2559 patch_prober.go:28] interesting pod/image-registry-9b6bfc5fd-gjkdz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:29.508731 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:29.508380    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:30.769286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:30.769253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:30.817995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:30.817952    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:37.598793 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:37.598760    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:37.699828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:37.699796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:38.942137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:38.942091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:39.110544 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.110495    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:39.185542 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.185502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:39.507462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.507438    2559 patch_prober.go:28] interesting pod/image-registry-9b6bfc5fd-gjkdz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:39.507608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.507498    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:39.577275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.577245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:39.632363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.632335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:39.825295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.825229    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:39.825295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:39.825273    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:41.873367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:41.873334    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:41.873755 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:41.873413    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:42.005305 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:42.005266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.077729 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.077694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.301448 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.301411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.337610 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.337522    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gjzns"]
Sep 09 17:21:44.342877 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.342850    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345589    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345616    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4v4kg\""
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 17:21:44.345746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 17:21:44.346124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.345936    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 17:21:44.355673 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-textfile\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-wtmp\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-tls\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-metrics-client-ca\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9m2d\" (UniqueName: \"kubernetes.io/projected/c7e53a13-b062-4ab2-ae39-a0e80813dbef-kube-api-access-m9m2d\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-sys\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.355948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.355858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-root\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.382776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.382746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.445429 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.445395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.456397 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-textfile\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-wtmp\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-tls\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-metrics-client-ca\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9m2d\" (UniqueName: \"kubernetes.io/projected/c7e53a13-b062-4ab2-ae39-a0e80813dbef-kube-api-access-m9m2d\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-sys\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-wtmp\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-root\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-sys\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.456770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e53a13-b062-4ab2-ae39-a0e80813dbef-root\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.457023 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.456859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-textfile\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.457186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.457164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.457569 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.457550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e53a13-b062-4ab2-ae39-a0e80813dbef-metrics-client-ca\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.459505 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.459483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.459658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.459639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e53a13-b062-4ab2-ae39-a0e80813dbef-node-exporter-tls\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.465124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.465096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9m2d\" (UniqueName: \"kubernetes.io/projected/c7e53a13-b062-4ab2-ae39-a0e80813dbef-kube-api-access-m9m2d\") pod \"node-exporter-gjzns\" (UID: \"c7e53a13-b062-4ab2-ae39-a0e80813dbef\") " pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.523286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.523249    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry" containerID="cri-o://9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139" gracePeriod=30
Sep 09 17:21:44.587907 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.587841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.652613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.652586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gjzns"
Sep 09 17:21:44.664111 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:44.664086    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e53a13_b062_4ab2_ae39_a0e80813dbef.slice/crio-c4c96d6cc34bb1e32bf7958303dc01d0079b5313860f5be3f1f8bb7924a26a50 WatchSource:0}: Error finding container c4c96d6cc34bb1e32bf7958303dc01d0079b5313860f5be3f1f8bb7924a26a50: Status 404 returned error can't find the container with id c4c96d6cc34bb1e32bf7958303dc01d0079b5313860f5be3f1f8bb7924a26a50
Sep 09 17:21:44.687692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.687661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:44.756157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.756136    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:44.860111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860043    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860076    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860100    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860126    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np476\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860510 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860510 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860400    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") pod \"f583bf57-4fde-4117-8f5b-894afb80a812\" (UID: \"f583bf57-4fde-4117-8f5b-894afb80a812\") "
Sep 09 17:21:44.860607 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:21:44.860607 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860555    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:21:44.860721 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860638    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-trusted-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.860721 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.860654    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f583bf57-4fde-4117-8f5b-894afb80a812-registry-certificates\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.862795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.862761    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476" (OuterVolumeSpecName: "kube-api-access-np476") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "kube-api-access-np476". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:21:44.863071 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.863050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:21:44.863169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.863081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:21:44.863169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.863154    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:21:44.863334 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.863315    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:21:44.868492 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.868473    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f583bf57-4fde-4117-8f5b-894afb80a812" (UID: "f583bf57-4fde-4117-8f5b-894afb80a812"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:21:44.958783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.958755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjzns" event={"ID":"c7e53a13-b062-4ab2-ae39-a0e80813dbef","Type":"ContainerStarted","Data":"c4c96d6cc34bb1e32bf7958303dc01d0079b5313860f5be3f1f8bb7924a26a50"}
Sep 09 17:21:44.960042 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960015    2559 generic.go:356] "Generic (PLEG): container finished" podID="f583bf57-4fde-4117-8f5b-894afb80a812" containerID="9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139" exitCode=0
Sep 09 17:21:44.960138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960051    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"
Sep 09 17:21:44.960138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" event={"ID":"f583bf57-4fde-4117-8f5b-894afb80a812","Type":"ContainerDied","Data":"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"}
Sep 09 17:21:44.960138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b6bfc5fd-gjkdz" event={"ID":"f583bf57-4fde-4117-8f5b-894afb80a812","Type":"ContainerDied","Data":"e573b96e6380884f2fbb520d84a61739407a8e3eb8e2a7c0dc799dfce169ef46"}
Sep 09 17:21:44.960259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960146    2559 scope.go:117] "RemoveContainer" containerID="9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"
Sep 09 17:21:44.961013 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.960992    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-bound-sa-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.961131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.961018    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-image-registry-private-configuration\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.961131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.961034    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-registry-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.961131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.961047    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f583bf57-4fde-4117-8f5b-894afb80a812-installation-pull-secrets\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.961131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.961060    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f583bf57-4fde-4117-8f5b-894afb80a812-ca-trust-extracted\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.961131 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.961073    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np476\" (UniqueName: \"kubernetes.io/projected/f583bf57-4fde-4117-8f5b-894afb80a812-kube-api-access-np476\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:21:44.968482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.968466    2559 scope.go:117] "RemoveContainer" containerID="9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"
Sep 09 17:21:44.968760 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:44.968741    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139\": container with ID starting with 9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139 not found: ID does not exist" containerID="9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"
Sep 09 17:21:44.968826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.968772    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139"} err="failed to get container status \"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139\": rpc error: code = NotFound desc = could not find container \"9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139\": container with ID starting with 9afb746971c5b743a37a3088c83deea8361b7aa84dbd214948e09a75b13a7139 not found: ID does not exist"
Sep 09 17:21:44.982900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.982876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:21:44.986527 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:44.986510    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9b6bfc5fd-gjkdz"]
Sep 09 17:21:45.050724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.050698    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" path="/var/lib/kubelet/pods/f583bf57-4fde-4117-8f5b-894afb80a812/volumes"
Sep 09 17:21:45.059832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.059807    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:45.313782 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.313750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:45.419976 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.419927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:45.427818 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.427787    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:21:45.428035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.428024    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry"
Sep 09 17:21:45.428077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.428038    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry"
Sep 09 17:21:45.428113 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.428085    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f583bf57-4fde-4117-8f5b-894afb80a812" containerName="registry"
Sep 09 17:21:45.433204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.433186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.435550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.435530    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 17:21:45.435550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.435530    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 17:21:45.435669 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.435530    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 17:21:45.436005 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.435992    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 17:21:45.436052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.436002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7pvbm\""
Sep 09 17:21:45.436247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.436234    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 17:21:45.436298 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.436264    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 17:21:45.437365 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.437350    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 17:21:45.437365 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.437360    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 17:21:45.437494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.437352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 17:21:45.449315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.449296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:21:45.464391 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464481 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkg7\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464481 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464650 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.464915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.464829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.515864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.515836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:45.566110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkg7\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566354 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566410 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.566599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.566802 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:45.566663    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle podName:c994ed9f-9766-4d9d-ae2b-7d7cb066a80c nodeName:}" failed. No retries permitted until 2026-09-09 17:21:46.066641953 +0000 UTC m=+277.484239080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c") : configmap references non-existent config key: ca-bundle.crt
Sep 09 17:21:45.569353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.569325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.569353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.569340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.569996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.569734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.569996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.569908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.570306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.570022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.570306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.570030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.571491 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.571418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.571491 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.571420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.573162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.572450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.575485 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.575459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:45.575574 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:45.575544    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkg7\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:46.070400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.070359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:46.071215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.071193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:46.342759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.342705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:21:46.619255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.619231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:21:46.620653 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:46.620631    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc994ed9f_9766_4d9d_ae2b_7d7cb066a80c.slice/crio-8a9d62cd5e98c4cbf2e22323e90944825236a41cc998c7a3642ccc47a45a4834 WatchSource:0}: Error finding container 8a9d62cd5e98c4cbf2e22323e90944825236a41cc998c7a3642ccc47a45a4834: Status 404 returned error can't find the container with id 8a9d62cd5e98c4cbf2e22323e90944825236a41cc998c7a3642ccc47a45a4834
Sep 09 17:21:46.969179 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.969148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"8a9d62cd5e98c4cbf2e22323e90944825236a41cc998c7a3642ccc47a45a4834"}
Sep 09 17:21:46.970587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.970564    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7e53a13-b062-4ab2-ae39-a0e80813dbef" containerID="f6418e649c20d2603274837cbcd128679d3298ad162365646200dea4eca35aa9" exitCode=0
Sep 09 17:21:46.970674 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:46.970593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjzns" event={"ID":"c7e53a13-b062-4ab2-ae39-a0e80813dbef","Type":"ContainerDied","Data":"f6418e649c20d2603274837cbcd128679d3298ad162365646200dea4eca35aa9"}
Sep 09 17:21:47.260168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.259290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:47.354385 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.354325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:47.976397 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.976372    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a" exitCode=0
Sep 09 17:21:47.976544 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.976458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"}
Sep 09 17:21:47.978942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.978919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjzns" event={"ID":"c7e53a13-b062-4ab2-ae39-a0e80813dbef","Type":"ContainerStarted","Data":"fffa4c8ec85b071bafc06b1de7998c949c2e897ff1e40ee6ea701b2ac2ad1e94"}
Sep 09 17:21:47.979076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:47.978989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjzns" event={"ID":"c7e53a13-b062-4ab2-ae39-a0e80813dbef","Type":"ContainerStarted","Data":"e9d7856ca6e89800331965eece79ef70e6b07e4d49cedaacf191223d6f3678c8"}
Sep 09 17:21:48.024509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.024466    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gjzns" podStartSLOduration=2.452304798 podStartE2EDuration="4.024453471s" totalImagesPullingTime="1.504899445s" totalInitContainerRuntime="67.249228ms" isStatefulPod=true podCreationTimestamp="2026-09-09 17:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:48.023810753 +0000 UTC m=+279.441407919" watchObservedRunningTime="2026-09-09 17:21:48.024453471 +0000 UTC m=+279.442050620"
Sep 09 17:21:48.085533 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.085439    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:48.380817 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.380731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:48.434974 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.434943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:48.629586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.629548    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c77d6b755-xmzl9"]
Sep 09 17:21:48.632642 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.632585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.636236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636214    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 17:21:48.636856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636721    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-24b7k4a7ogf3r\""
Sep 09 17:21:48.636856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636728    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vdtrk\""
Sep 09 17:21:48.636856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 17:21:48.636856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636796    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 17:21:48.636856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.636848    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 17:21:48.641144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.641122    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c77d6b755-xmzl9"]
Sep 09 17:21:48.690654 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-tls\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.690810 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-client-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.690810 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnq4z\" (UniqueName: \"kubernetes.io/projected/02aad26f-914f-4add-84a5-747dc40e4683-kube-api-access-mnq4z\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.690895 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690822    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02aad26f-914f-4add-84a5-747dc40e4683-audit-log\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.690951 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-client-certs\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.690951 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.691078 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.690987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-metrics-server-audit-profiles\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.791728 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-client-certs\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.791900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.791900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-metrics-server-audit-profiles\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.791900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-tls\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.791900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-client-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.792154 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnq4z\" (UniqueName: \"kubernetes.io/projected/02aad26f-914f-4add-84a5-747dc40e4683-kube-api-access-mnq4z\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.792154 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.791983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02aad26f-914f-4add-84a5-747dc40e4683-audit-log\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.792358 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.792329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02aad26f-914f-4add-84a5-747dc40e4683-audit-log\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.792678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.792612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.792882 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.792837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02aad26f-914f-4add-84a5-747dc40e4683-metrics-server-audit-profiles\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.794885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.794862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-tls\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.795033 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.795010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-secret-metrics-server-client-certs\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.795109 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.795033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02aad26f-914f-4add-84a5-747dc40e4683-client-ca-bundle\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.800772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.800748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnq4z\" (UniqueName: \"kubernetes.io/projected/02aad26f-914f-4add-84a5-747dc40e4683-kube-api-access-mnq4z\") pod \"metrics-server-7c77d6b755-xmzl9\" (UID: \"02aad26f-914f-4add-84a5-747dc40e4683\") " pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:48.945164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:48.945121    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:21:49.122118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.122086    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"]
Sep 09 17:21:49.126422 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.126399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.128766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.128746    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 17:21:49.128852 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.128754    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b5jnd\""
Sep 09 17:21:49.136047 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.136024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:49.136436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.136405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"]
Sep 09 17:21:49.196704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.196629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqxl\" (UniqueName: \"kubernetes.io/projected/17328082-4c99-4c15-a1e7-b9925b62f9d4-kube-api-access-8mqxl\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.196846 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.196739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.222237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.222212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c77d6b755-xmzl9"]
Sep 09 17:21:49.297343 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.297303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqxl\" (UniqueName: \"kubernetes.io/projected/17328082-4c99-4c15-a1e7-b9925b62f9d4-kube-api-access-8mqxl\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.297499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.297392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.297562 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:49.297527    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 09 17:21:49.297627 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:49.297615    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert podName:17328082-4c99-4c15-a1e7-b9925b62f9d4 nodeName:}" failed. No retries permitted until 2026-09-09 17:21:49.797598936 +0000 UTC m=+281.215196083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-nnstf" (UID: "17328082-4c99-4c15-a1e7-b9925b62f9d4") : secret "monitoring-plugin-cert" not found
Sep 09 17:21:49.308196 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.308171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqxl\" (UniqueName: \"kubernetes.io/projected/17328082-4c99-4c15-a1e7-b9925b62f9d4-kube-api-access-8mqxl\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.343043 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:49.343017    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02aad26f_914f_4add_84a5_747dc40e4683.slice/crio-6833ffb8d53be4524c34d4c57a2bb86d71229034d31f0c4a6a74d6a60df947c4 WatchSource:0}: Error finding container 6833ffb8d53be4524c34d4c57a2bb86d71229034d31f0c4a6a74d6a60df947c4: Status 404 returned error can't find the container with id 6833ffb8d53be4524c34d4c57a2bb86d71229034d31f0c4a6a74d6a60df947c4
Sep 09 17:21:49.588069 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:21:49.588037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v2ht2" podUID="3e4d10ae-4742-47b4-8ef9-e8150bc3acb7"
Sep 09 17:21:49.800829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.800752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.803226 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.803205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/17328082-4c99-4c15-a1e7-b9925b62f9d4-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-nnstf\" (UID: \"17328082-4c99-4c15-a1e7-b9925b62f9d4\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:49.824845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.824805    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:49.824955 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.824867    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:49.988688 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.988656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"}
Sep 09 17:21:49.988829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.988723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"}
Sep 09 17:21:49.988829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.988770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"}
Sep 09 17:21:49.988829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.988805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"}
Sep 09 17:21:49.988829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.988829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"}
Sep 09 17:21:49.989812 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.989790    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9" event={"ID":"02aad26f-914f-4add-84a5-747dc40e4683","Type":"ContainerStarted","Data":"6833ffb8d53be4524c34d4c57a2bb86d71229034d31f0c4a6a74d6a60df947c4"}
Sep 09 17:21:49.989891 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:49.989826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:21:50.038421 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.038397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:50.307883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.307840    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"]
Sep 09 17:21:50.378422 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:50.378357    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17328082_4c99_4c15_a1e7_b9925b62f9d4.slice/crio-07a8eef5bf0e0373f6d0b4eeca2e1eb0354818d4536e4861d524af5973ba2134 WatchSource:0}: Error finding container 07a8eef5bf0e0373f6d0b4eeca2e1eb0354818d4536e4861d524af5973ba2134: Status 404 returned error can't find the container with id 07a8eef5bf0e0373f6d0b4eeca2e1eb0354818d4536e4861d524af5973ba2134
Sep 09 17:21:50.537449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.537416    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:21:50.541385 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.541358    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.544381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544213    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 17:21:50.544381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6buojmkjcp1m9\""
Sep 09 17:21:50.544381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544281    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 17:21:50.544381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544288    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 17:21:50.544381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544341    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 17:21:50.544685 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544459    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 17:21:50.544780 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 17:21:50.544897 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6jgr8\""
Sep 09 17:21:50.544991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.544979    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 17:21:50.546240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.545998    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 17:21:50.546240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.546067    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 17:21:50.546240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.546107    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 17:21:50.546240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.545997    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 17:21:50.546807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.546764    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 17:21:50.558529 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.558503    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 17:21:50.559164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.559143    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 17:21:50.560537 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.560518    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:21:50.608575 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.608921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.608985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkdc\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.609502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.609373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.683840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.683788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:50.709919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.709888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.709923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.709946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkdc\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.710660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.710600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.711292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.711197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.711706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.712492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.712796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.713339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.713500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.714351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.715942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.715940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.716651 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.716184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.716651 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.716488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.717008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.716948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.717144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.717124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.717482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.717460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.717696 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.717680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.720530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.720501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkdc\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc\") pod \"prometheus-k8s-0\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.859798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.859764    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:21:50.997885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.997814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerStarted","Data":"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"}
Sep 09 17:21:50.999188 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:50.999164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf" event={"ID":"17328082-4c99-4c15-a1e7-b9925b62f9d4","Type":"ContainerStarted","Data":"07a8eef5bf0e0373f6d0b4eeca2e1eb0354818d4536e4861d524af5973ba2134"}
Sep 09 17:21:51.028602 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:51.028554    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.664935268 podStartE2EDuration="6.028536969s" totalImagesPullingTime="3.347766014s" totalInitContainerRuntime="15.835687ms" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:51.025847766 +0000 UTC m=+282.443444952" watchObservedRunningTime="2026-09-09 17:21:51.028536969 +0000 UTC m=+282.446134147"
Sep 09 17:21:51.284137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:51.284057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:21:51.288267 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:51.288238    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80841726_7427_4b06_a816_dd2e3afb60ef.slice/crio-1cb2fbbe6d06d7a7cb5d29987b2a3e57cd12ff5230049e87a5c8e1204e5e2592 WatchSource:0}: Error finding container 1cb2fbbe6d06d7a7cb5d29987b2a3e57cd12ff5230049e87a5c8e1204e5e2592: Status 404 returned error can't find the container with id 1cb2fbbe6d06d7a7cb5d29987b2a3e57cd12ff5230049e87a5c8e1204e5e2592
Sep 09 17:21:51.873866 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:51.873835    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:51.874278 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:51.873889    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:52.004531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:52.004502    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca" exitCode=0
Sep 09 17:21:52.004643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:52.004608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"}
Sep 09 17:21:52.004723 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:52.004697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"1cb2fbbe6d06d7a7cb5d29987b2a3e57cd12ff5230049e87a5c8e1204e5e2592"}
Sep 09 17:21:52.006500 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:52.006464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9" event={"ID":"02aad26f-914f-4add-84a5-747dc40e4683","Type":"ContainerStarted","Data":"2186e21e366d4476e9e936f4561ca26e34fd9dca87ec16dbc8b3a16a520a5d17"}
Sep 09 17:21:52.047291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:52.047251    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9" podStartSLOduration=2.339774575 podStartE2EDuration="4.047235655s" totalImagesPullingTime="1.70746108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:52.046223564 +0000 UTC m=+283.463820714" watchObservedRunningTime="2026-09-09 17:21:52.047235655 +0000 UTC m=+283.464832803"
Sep 09 17:21:53.014021 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.013973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf" event={"ID":"17328082-4c99-4c15-a1e7-b9925b62f9d4","Type":"ContainerStarted","Data":"d04ef051f3639954e4f68e569584d01cc1bc6a32d583fb756e1060a0af57144a"}
Sep 09 17:21:53.029776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.029718    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf" podStartSLOduration=2.426220333 podStartE2EDuration="4.029699766s" totalImagesPullingTime="1.603479433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:53.02934826 +0000 UTC m=+284.446945411" watchObservedRunningTime="2026-09-09 17:21:53.029699766 +0000 UTC m=+284.447296917"
Sep 09 17:21:53.435278 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.435241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:21:53.438032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.438004    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e4d10ae-4742-47b4-8ef9-e8150bc3acb7-metrics-tls\") pod \"dns-default-v2ht2\" (UID: \"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7\") " pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:21:53.593130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.593099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cblwm\""
Sep 09 17:21:53.601040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.601012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:21:53.881565 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:53.881533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2ht2"]
Sep 09 17:21:53.884331 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:21:53.884298    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4d10ae_4742_47b4_8ef9_e8150bc3acb7.slice/crio-5bca23f30ffcdd12cb1b0a3308e747970cf42bee861f86b7a16e2a30647150b0 WatchSource:0}: Error finding container 5bca23f30ffcdd12cb1b0a3308e747970cf42bee861f86b7a16e2a30647150b0: Status 404 returned error can't find the container with id 5bca23f30ffcdd12cb1b0a3308e747970cf42bee861f86b7a16e2a30647150b0
Sep 09 17:21:54.021315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:54.021246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2ht2" event={"ID":"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7","Type":"ContainerStarted","Data":"5bca23f30ffcdd12cb1b0a3308e747970cf42bee861f86b7a16e2a30647150b0"}
Sep 09 17:21:54.021777 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:54.021574    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:54.027877 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:54.027851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-nnstf"
Sep 09 17:21:56.102914 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:56.102872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:56.151917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:56.151879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:57.037212 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.037177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2ht2" event={"ID":"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7","Type":"ContainerStarted","Data":"d649d031b81dd9dfc3801fc7df18d19540a3d8d8bda8baf04b295be7da3c0c70"}
Sep 09 17:21:57.037518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.037276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2ht2" event={"ID":"3e4d10ae-4742-47b4-8ef9-e8150bc3acb7","Type":"ContainerStarted","Data":"2847b65a869a630fffbda4c59108cd664d2c54d1f375d217940b68e058a26220"}
Sep 09 17:21:57.037518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.037311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:21:57.039571 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.039548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"}
Sep 09 17:21:57.039679 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.039597    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"}
Sep 09 17:21:57.053332 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.053287    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2ht2" podStartSLOduration=251.610052189 podStartE2EDuration="4m14.053272317s" totalImagesPullingTime="2.443220128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:57.052016688 +0000 UTC m=+288.469613838" watchObservedRunningTime="2026-09-09 17:21:57.053272317 +0000 UTC m=+288.470869466"
Sep 09 17:21:57.854630 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.854594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:57.934539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:57.934419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:58.216580 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:58.216534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:58.317612 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:58.317556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:59.053063 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.053026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"}
Sep 09 17:21:59.053482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.053101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"}
Sep 09 17:21:59.053482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.053142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"}
Sep 09 17:21:59.053482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.053181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerStarted","Data":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"}
Sep 09 17:21:59.081467 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.080984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.853987079 podStartE2EDuration="9.08094488s" totalImagesPullingTime="6.205651182s" totalInitContainerRuntime="21.306619ms" isStatefulPod=false podCreationTimestamp="2026-09-09 17:21:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:21:59.078285607 +0000 UTC m=+290.495882778" watchObservedRunningTime="2026-09-09 17:21:59.08094488 +0000 UTC m=+290.498542030"
Sep 09 17:21:59.259484 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.259451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:59.361695 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.361619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:21:59.826546 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.826513    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:59.826713 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.826575    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:59.826713 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.826613    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:21:59.827152 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.827129    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"d05a2be4c2d7965d2e36a7dac6595885203e45ea758da93aa40eb2c4fc88b08e"} pod="openshift-image-registry/image-registry-5748c46786-p68wg" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 17:21:59.830678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.830649    2559 patch_prober.go:28] interesting pod/image-registry-5748c46786-p68wg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 17:21:59.830754 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.830706    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:21:59.962515 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:21:59.962479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:00.136709 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:00.136627    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:00.860871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:00.860844    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:22:01.151126 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:01.151053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:01.298434 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:01.298405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:01.357286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:01.357261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:01.499604 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:01.499581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:05.064172 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:05.064135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:05.164447 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:05.164418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:07.050953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:07.050924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2ht2"
Sep 09 17:22:08.945307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:08.945271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:22:08.945700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:08.945360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:22:08.978730 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:08.978707    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:22:08.979652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:08.979630    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:22:08.985200 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:08.985184    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 17:22:09.831000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:09.830934    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:22:09.977510 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:09.977477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:10.026450 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:10.026418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:10.099167 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:10.099090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:10.201604 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:10.201565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:10.258228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:10.258198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:14.241788 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:14.241750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:14.294766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:14.294733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:19.163996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:19.163947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:19.240718 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:19.240684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:20.119419 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:20.119384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:20.221118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:20.221086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:23.363052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:23.363019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:23.463876 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:23.463844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:24.846251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:24.846204    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5748c46786-p68wg" podUID="d465801e-f07c-4a37-b78e-523691aa6973" containerName="registry" containerID="cri-o://d05a2be4c2d7965d2e36a7dac6595885203e45ea758da93aa40eb2c4fc88b08e" gracePeriod=30
Sep 09 17:22:26.151173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.151136    2559 generic.go:356] "Generic (PLEG): container finished" podID="d465801e-f07c-4a37-b78e-523691aa6973" containerID="d05a2be4c2d7965d2e36a7dac6595885203e45ea758da93aa40eb2c4fc88b08e" exitCode=0
Sep 09 17:22:26.151567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.151230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5748c46786-p68wg" event={"ID":"d465801e-f07c-4a37-b78e-523691aa6973","Type":"ContainerDied","Data":"d05a2be4c2d7965d2e36a7dac6595885203e45ea758da93aa40eb2c4fc88b08e"}
Sep 09 17:22:26.151567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.151284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5748c46786-p68wg" event={"ID":"d465801e-f07c-4a37-b78e-523691aa6973","Type":"ContainerStarted","Data":"84d56350fd919ac5fda9a008ba561493cd5ad62f884173abcd4721f38f6bb7a9"}
Sep 09 17:22:26.151567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.151311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:22:26.152803 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.152771    2559 generic.go:356] "Generic (PLEG): container finished" podID="3fc45dc0-c198-4be0-861f-b06b2c194d90" containerID="a93894bb48587db92f2d8677e88a8c9c8c39bf345bf77772fe67c0014d965598" exitCode=0
Sep 09 17:22:26.152912 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.152827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2" event={"ID":"3fc45dc0-c198-4be0-861f-b06b2c194d90","Type":"ContainerDied","Data":"a93894bb48587db92f2d8677e88a8c9c8c39bf345bf77772fe67c0014d965598"}
Sep 09 17:22:26.153115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.153100    2559 scope.go:117] "RemoveContainer" containerID="a93894bb48587db92f2d8677e88a8c9c8c39bf345bf77772fe67c0014d965598"
Sep 09 17:22:26.383503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.383419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:26.432439 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.432405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:26.934620 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:26.934590    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5748c46786-p68wg_d465801e-f07c-4a37-b78e-523691aa6973/registry/0.log"
Sep 09 17:22:27.100055 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:27.100029    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5748c46786-p68wg_d465801e-f07c-4a37-b78e-523691aa6973/registry/1.log"
Sep 09 17:22:27.158434 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:27.158399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p5qz2" event={"ID":"3fc45dc0-c198-4be0-861f-b06b2c194d90","Type":"ContainerStarted","Data":"1f80fd2ad26f034c941ad97bbcfc91d36cc84efecfc19ab9583f6b55709c4baf"}
Sep 09 17:22:27.699379 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:27.699354    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ws7cp_28e7e799-a82e-4bc3-b751-82b3701b04af/node-ca/0.log"
Sep 09 17:22:27.900256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:27.900221    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d6dd55f6-6pkr7_364f5751-5f64-4334-b85a-37e12355d575/router/0.log"
Sep 09 17:22:28.299989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:28.299940    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lql8n_f9df9e62-7b30-46f5-937e-7629b918f504/serve-healthcheck-canary/0.log"
Sep 09 17:22:28.950412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:28.950380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:22:28.954831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:28.954808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c77d6b755-xmzl9"
Sep 09 17:22:35.065979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:35.065926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:35.117112 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:35.117074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:35.733257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:35.733223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:41.474945 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:41.474908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:41.576187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:41.576146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:41.636048 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:41.636019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:47.163452 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:47.163422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5748c46786-p68wg"
Sep 09 17:22:47.411361 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:47.411327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:47.459331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:47.459304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:50.094596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:50.094561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:50.144118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:50.144082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:22:50.860831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:50.860794    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:22:50.877059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:50.877031    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:22:51.266608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:22:51.266580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:01.519795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:01.519713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:01.619345 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:01.619295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:03.571494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:03.571460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:03.776130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:03.776094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:04.581265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581230    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:23:04.581647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581522    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="alertmanager" containerID="cri-o://94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1" gracePeriod=120
Sep 09 17:23:04.581647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581584    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-metric" containerID="cri-o://4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3" gracePeriod=120
Sep 09 17:23:04.581647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581610    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-web" containerID="cri-o://e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901" gracePeriod=120
Sep 09 17:23:04.581820 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581634    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="config-reloader" containerID="cri-o://e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345" gracePeriod=120
Sep 09 17:23:04.581820 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581681    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="prom-label-proxy" containerID="cri-o://7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927" gracePeriod=120
Sep 09 17:23:04.582813 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:04.581627    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy" containerID="cri-o://682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395" gracePeriod=120
Sep 09 17:23:05.063462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.063427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:05.114790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.114765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:05.305035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305001    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927" exitCode=0
Sep 09 17:23:05.305035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305026    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395" exitCode=0
Sep 09 17:23:05.305035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305032    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345" exitCode=0
Sep 09 17:23:05.305035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305038    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1" exitCode=0
Sep 09 17:23:05.305275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"}
Sep 09 17:23:05.305275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305137    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"}
Sep 09 17:23:05.305275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"}
Sep 09 17:23:05.305275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.305190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"}
Sep 09 17:23:05.829826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.829803    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:23:05.931543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931523    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931561    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931584    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfkg7\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931700    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931838    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931867    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.931943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.931936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume\") pod \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\" (UID: \"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c\") "
Sep 09 17:23:05.932323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.932030    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:05.932323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.932077    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:05.932323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.932247    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:05.932323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.932269    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-metrics-client-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:05.933181 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.933113    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:23:05.934884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.934835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:23:05.934884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.934860    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.935277 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.935217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.935508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.935484    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.936631 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.936607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out" (OuterVolumeSpecName: "config-out") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:23:05.936930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.936902    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.936930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.936909    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7" (OuterVolumeSpecName: "kube-api-access-rfkg7") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "kube-api-access-rfkg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:23:05.937077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.936953    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume" (OuterVolumeSpecName: "config-volume") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.940148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.940123    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:05.945738 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:05.945714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config" (OuterVolumeSpecName: "web-config") pod "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" (UID: "c994ed9f-9766-4d9d-ae2b-7d7cb066a80c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:06.033286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033247    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfkg7\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-kube-api-access-rfkg7\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033280    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-web-config\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033290    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-cluster-tls-config\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033298    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-out\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033306    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033315    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-alertmanager-main-db\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033323    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-main-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033331    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-config-volume\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033339    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-tls-assets\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033347    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.033477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.033357    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:06.312054 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.311950    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3" exitCode=0
Sep 09 17:23:06.312054 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.311996    2559 generic.go:356] "Generic (PLEG): container finished" podID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerID="e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901" exitCode=0
Sep 09 17:23:06.312054 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.312017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"}
Sep 09 17:23:06.312054 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.312035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 17:23:06.312305 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.312083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"}
Sep 09 17:23:06.312305 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.312111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c994ed9f-9766-4d9d-ae2b-7d7cb066a80c","Type":"ContainerDied","Data":"8a9d62cd5e98c4cbf2e22323e90944825236a41cc998c7a3642ccc47a45a4834"}
Sep 09 17:23:06.312305 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.312140    2559 scope.go:117] "RemoveContainer" containerID="7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"
Sep 09 17:23:06.320060 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.320042    2559 scope.go:117] "RemoveContainer" containerID="4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"
Sep 09 17:23:06.327191 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.327175    2559 scope.go:117] "RemoveContainer" containerID="682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"
Sep 09 17:23:06.335146 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.335112    2559 scope.go:117] "RemoveContainer" containerID="e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"
Sep 09 17:23:06.337086 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.337059    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:23:06.343516 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.343495    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 17:23:06.343798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.343782    2559 scope.go:117] "RemoveContainer" containerID="e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"
Sep 09 17:23:06.350812 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.350794    2559 scope.go:117] "RemoveContainer" containerID="94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"
Sep 09 17:23:06.357708 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.357690    2559 scope.go:117] "RemoveContainer" containerID="23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"
Sep 09 17:23:06.365658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.365631    2559 scope.go:117] "RemoveContainer" containerID="7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"
Sep 09 17:23:06.365990 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.365940    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927\": container with ID starting with 7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927 not found: ID does not exist" containerID="7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"
Sep 09 17:23:06.366101 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366005    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"} err="failed to get container status \"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927\": rpc error: code = NotFound desc = could not find container \"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927\": container with ID starting with 7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927 not found: ID does not exist"
Sep 09 17:23:06.366101 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366034    2559 scope.go:117] "RemoveContainer" containerID="4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"
Sep 09 17:23:06.366402 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.366383    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3\": container with ID starting with 4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3 not found: ID does not exist" containerID="4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"
Sep 09 17:23:06.366493 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366406    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"} err="failed to get container status \"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3\": rpc error: code = NotFound desc = could not find container \"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3\": container with ID starting with 4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3 not found: ID does not exist"
Sep 09 17:23:06.366493 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366423    2559 scope.go:117] "RemoveContainer" containerID="682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"
Sep 09 17:23:06.366679 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.366663    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395\": container with ID starting with 682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395 not found: ID does not exist" containerID="682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"
Sep 09 17:23:06.366720 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366683    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"} err="failed to get container status \"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395\": rpc error: code = NotFound desc = could not find container \"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395\": container with ID starting with 682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395 not found: ID does not exist"
Sep 09 17:23:06.366720 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.366696    2559 scope.go:117] "RemoveContainer" containerID="e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"
Sep 09 17:23:06.367001 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.366978    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901\": container with ID starting with e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901 not found: ID does not exist" containerID="e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"
Sep 09 17:23:06.367071 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367006    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"} err="failed to get container status \"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901\": rpc error: code = NotFound desc = could not find container \"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901\": container with ID starting with e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901 not found: ID does not exist"
Sep 09 17:23:06.367071 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367025    2559 scope.go:117] "RemoveContainer" containerID="e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"
Sep 09 17:23:06.367279 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.367248    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345\": container with ID starting with e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345 not found: ID does not exist" containerID="e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"
Sep 09 17:23:06.367279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367267    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"} err="failed to get container status \"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345\": rpc error: code = NotFound desc = could not find container \"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345\": container with ID starting with e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345 not found: ID does not exist"
Sep 09 17:23:06.367279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367279    2559 scope.go:117] "RemoveContainer" containerID="94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"
Sep 09 17:23:06.367494 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.367479    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1\": container with ID starting with 94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1 not found: ID does not exist" containerID="94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"
Sep 09 17:23:06.367530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367497    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"} err="failed to get container status \"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1\": rpc error: code = NotFound desc = could not find container \"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1\": container with ID starting with 94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1 not found: ID does not exist"
Sep 09 17:23:06.367530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367508    2559 scope.go:117] "RemoveContainer" containerID="23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"
Sep 09 17:23:06.367721 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:06.367702    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a\": container with ID starting with 23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a not found: ID does not exist" containerID="23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"
Sep 09 17:23:06.367764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367726    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"} err="failed to get container status \"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a\": rpc error: code = NotFound desc = could not find container \"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a\": container with ID starting with 23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a not found: ID does not exist"
Sep 09 17:23:06.367764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367739    2559 scope.go:117] "RemoveContainer" containerID="7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"
Sep 09 17:23:06.367988 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367949    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927"} err="failed to get container status \"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927\": rpc error: code = NotFound desc = could not find container \"7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927\": container with ID starting with 7b56bf1ed9adef3f02a25635148244c259a691423b174c34621ba0b061d2f927 not found: ID does not exist"
Sep 09 17:23:06.368063 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.367991    2559 scope.go:117] "RemoveContainer" containerID="4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"
Sep 09 17:23:06.368218 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368201    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3"} err="failed to get container status \"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3\": rpc error: code = NotFound desc = could not find container \"4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3\": container with ID starting with 4f311b8cb159256ee8ee8abcf93cd9abcd6e75557b3b185bb307955f19633cd3 not found: ID does not exist"
Sep 09 17:23:06.368262 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368219    2559 scope.go:117] "RemoveContainer" containerID="682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"
Sep 09 17:23:06.368417 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368402    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395"} err="failed to get container status \"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395\": rpc error: code = NotFound desc = could not find container \"682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395\": container with ID starting with 682f1ac6f2917306b2c11843f13321efd55482f5308d9b077978dab34ee70395 not found: ID does not exist"
Sep 09 17:23:06.368460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368418    2559 scope.go:117] "RemoveContainer" containerID="e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"
Sep 09 17:23:06.368607 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368590    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901"} err="failed to get container status \"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901\": rpc error: code = NotFound desc = could not find container \"e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901\": container with ID starting with e5fcea651a3cdf4f696ed7e994b78db65ea79a2d7f3e8e5a9b064e9f14584901 not found: ID does not exist"
Sep 09 17:23:06.368651 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368608    2559 scope.go:117] "RemoveContainer" containerID="e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"
Sep 09 17:23:06.368814 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368800    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345"} err="failed to get container status \"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345\": rpc error: code = NotFound desc = could not find container \"e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345\": container with ID starting with e32e97aab326b2e120e3a538b1699766b5c9b2c23eb3acf17c6e7ada17202345 not found: ID does not exist"
Sep 09 17:23:06.368900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.368815    2559 scope.go:117] "RemoveContainer" containerID="94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"
Sep 09 17:23:06.369020 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.369005    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1"} err="failed to get container status \"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1\": rpc error: code = NotFound desc = could not find container \"94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1\": container with ID starting with 94c019cf4bdec783eff1801ecf847c88b5d66cd7713b07463382752951f6d6d1 not found: ID does not exist"
Sep 09 17:23:06.369063 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.369021    2559 scope.go:117] "RemoveContainer" containerID="23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"
Sep 09 17:23:06.369204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:06.369184    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a"} err="failed to get container status \"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a\": rpc error: code = NotFound desc = could not find container \"23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a\": container with ID starting with 23d835ebea1a301e8973df7c752b6744b369a206c5be64a51a7997a02f83c08a not found: ID does not exist"
Sep 09 17:23:07.050813 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:07.050782    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" path="/var/lib/kubelet/pods/c994ed9f-9766-4d9d-ae2b-7d7cb066a80c/volumes"
Sep 09 17:23:08.931885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.931856    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:08.932312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932144    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="prometheus" containerID="cri-o://84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703" gracePeriod=600
Sep 09 17:23:08.932312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932169    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy" containerID="cri-o://2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402" gracePeriod=600
Sep 09 17:23:08.932312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932186    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-web" containerID="cri-o://b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386" gracePeriod=600
Sep 09 17:23:08.932312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932224    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="config-reloader" containerID="cri-o://6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f" gracePeriod=600
Sep 09 17:23:08.932312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932191    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="thanos-sidecar" containerID="cri-o://6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122" gracePeriod=600
Sep 09 17:23:08.932521 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:08.932222    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9" gracePeriod=600
Sep 09 17:23:09.177765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.177741    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.258906 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.258906 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.258906 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.258906 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.258949    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259151    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259190    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lkdc\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259243    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259297    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259323    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259340    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259369    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259391    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259442    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259550    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file\") pod \"80841726-7427-4b06-a816-dd2e3afb60ef\" (UID: \"80841726-7427-4b06-a816-dd2e3afb60ef\") "
Sep 09 17:23:09.259725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259614    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.259841    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.260047    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.260339    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.260877    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.261681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.261114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.263547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.263431    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:23:09.263738 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.263709    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.263738 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.263727    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:23:09.264472 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.264436    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.264566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.264522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config" (OuterVolumeSpecName: "config") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.265683 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.265645    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc" (OuterVolumeSpecName: "kube-api-access-9lkdc") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "kube-api-access-9lkdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:23:09.265683 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.265655    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.265683 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.265657    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.265887 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.265845    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.265951 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.265928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.266189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.266167    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:23:09.266796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.266777    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out" (OuterVolumeSpecName: "config-out") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:23:09.267243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.267218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.273771 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.273748    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config" (OuterVolumeSpecName: "web-config") pod "80841726-7427-4b06-a816-dd2e3afb60ef" (UID: "80841726-7427-4b06-a816-dd2e3afb60ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:23:09.326049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326023    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9" exitCode=0
Sep 09 17:23:09.326049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326045    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402" exitCode=0
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326054    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386" exitCode=0
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326062    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122" exitCode=0
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326067    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f" exitCode=0
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326071    2559 generic.go:356] "Generic (PLEG): container finished" podID="80841726-7427-4b06-a816-dd2e3afb60ef" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703" exitCode=0
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326098    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.326169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326113    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326211    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326249    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326301    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"}
Sep 09 17:23:09.326360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.326325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80841726-7427-4b06-a816-dd2e3afb60ef","Type":"ContainerDied","Data":"1cb2fbbe6d06d7a7cb5d29987b2a3e57cd12ff5230049e87a5c8e1204e5e2592"}
Sep 09 17:23:09.333658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.333640    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.340479 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.340462    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.347595 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.347579    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.353998 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.349831    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:09.354752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.354731    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:09.360000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.359978    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.360382 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360365    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360386    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-metrics-client-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360396    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-kube-rbac-proxy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360405    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-tls-assets\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360413    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360422    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-web-config\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360429    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360438    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360446    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lkdc\" (UniqueName: \"kubernetes.io/projected/80841726-7427-4b06-a816-dd2e3afb60ef-kube-api-access-9lkdc\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360453    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-metrics-client-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360462    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-config-out\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360469    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-db\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360477    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360485    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360493    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-config\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360500    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-grpc-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360508    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360516    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80841726-7427-4b06-a816-dd2e3afb60ef-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.360645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.360524    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80841726-7427-4b06-a816-dd2e3afb60ef-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:23:09.367115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.367095    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.374184 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.374165    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.377448 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377429    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:09.377686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="config-reloader"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377688    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="config-reloader"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377696    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="thanos-sidecar"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="thanos-sidecar"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377710    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377715    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377722    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="init-config-reloader"
Sep 09 17:23:09.377727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377727    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="init-config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377732    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377737    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377747    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-thanos"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377752    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-thanos"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377759    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="init-config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377763    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="init-config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377769    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377773    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377780    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="prom-label-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377785    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="prom-label-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377792    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="alertmanager"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377796    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="alertmanager"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377802    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377806    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377811    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377816    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-metric"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377827    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-metric"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377833    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="prometheus"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377838    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="prometheus"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377875    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377884    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377890    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="prometheus"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377902    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="kube-rbac-proxy-thanos"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377907    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-web"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377916    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="thanos-sidecar"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="kube-rbac-proxy-metric"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377927    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" containerName="config-reloader"
Sep 09 17:23:09.377920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377932    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="alertmanager"
Sep 09 17:23:09.378794 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377938    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="prom-label-proxy"
Sep 09 17:23:09.378794 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.377944    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994ed9f-9766-4d9d-ae2b-7d7cb066a80c" containerName="config-reloader"
Sep 09 17:23:09.381264 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381247    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.381539 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.381518    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.381586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381547    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.381586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381564    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.381754 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.381845 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.381824    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.381898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381853    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.381898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.381873    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.383461 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.383434    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.383557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.383470    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.383557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.383492    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.384332 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.384304    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.384332 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384341    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.384543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384361    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.384612 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384603    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 17:23:09.384670 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384628    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 17:23:09.384844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384826    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 17:23:09.384898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.384850    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 17:23:09.385095 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 17:23:09.385220 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.385196    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.385280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385225    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.385280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385237    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 17:23:09.385280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385245    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.385531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385299    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 17:23:09.385531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385342    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 17:23:09.385531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385340    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 17:23:09.385832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385707    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6jgr8\""
Sep 09 17:23:09.385832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 17:23:09.386041 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6buojmkjcp1m9\""
Sep 09 17:23:09.386041 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.385798    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 17:23:09.386169 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.386047    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.386169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386071    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.386169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386089    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.386508 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:23:09.386452    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.386508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386486    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.386508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386505    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.386868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386843    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.387025 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.386869    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.387296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387269    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.387371 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387297    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.387431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387405    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 17:23:09.387620 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 17:23:09.387707 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387647    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.387707 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387669    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.387984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387938    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.388074 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.387987    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.388304 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388278    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.388378 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388306    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.388589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388571    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.388661 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388589    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.388862 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388842    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.388862 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.388861    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.389164 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389142    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.389238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389167    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.389395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389378    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.389459 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389398    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.389715 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389680    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.389811 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389717    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.390000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389955    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.390000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.389997    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.390156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390059    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 17:23:09.390279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390258    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.390329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390279    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.390552 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390532    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.390661 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390552    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.390835 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390802    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.390900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.390836    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.391142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391122    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.391142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391140    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.391353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391335    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.391396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391356    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.391632 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391610    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.391679 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391633    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.391857 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391841    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.391857 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.391855    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.392107 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392083    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.392159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392112    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.392357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392342    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.392357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392355    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.392555 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392539    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.392597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392556    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.392730 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392715    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.392771 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392731    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.392934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392915    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.392934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.392933    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.393182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393166    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.393223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393182    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.393430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393412    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.393482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393430    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.393652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393636    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.393652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393651    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.393858 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393843    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.393858 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.393857    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.394053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394037    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.394053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394053    2559 scope.go:117] "RemoveContainer" containerID="2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"
Sep 09 17:23:09.394252 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394237    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9"} err="failed to get container status \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": rpc error: code = NotFound desc = could not find container \"2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9\": container with ID starting with 2167e228acedd000be0ef909c7778bb416ec5b3f72aaa06fa432b0edd674a8b9 not found: ID does not exist"
Sep 09 17:23:09.394298 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394252    2559 scope.go:117] "RemoveContainer" containerID="2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"
Sep 09 17:23:09.394460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394444    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402"} err="failed to get container status \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": rpc error: code = NotFound desc = could not find container \"2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402\": container with ID starting with 2aea9296e9e4bcddbc3c877c2928ac30f7f75d72840b14b8a44b0b17962cc402 not found: ID does not exist"
Sep 09 17:23:09.394460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394459    2559 scope.go:117] "RemoveContainer" containerID="b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"
Sep 09 17:23:09.394647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394633    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386"} err="failed to get container status \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": rpc error: code = NotFound desc = could not find container \"b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386\": container with ID starting with b95b704808e07aa68dac284723f3eb54a9b42081ab5d2ef820a617926f91f386 not found: ID does not exist"
Sep 09 17:23:09.394690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394647    2559 scope.go:117] "RemoveContainer" containerID="6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"
Sep 09 17:23:09.394840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394825    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122"} err="failed to get container status \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": rpc error: code = NotFound desc = could not find container \"6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122\": container with ID starting with 6764323ea1d9975562c3f5f622edfec6d966cca75d737d08109d8eb6cea88122 not found: ID does not exist"
Sep 09 17:23:09.394840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.394839    2559 scope.go:117] "RemoveContainer" containerID="6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"
Sep 09 17:23:09.395028 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.395012    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f"} err="failed to get container status \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": rpc error: code = NotFound desc = could not find container \"6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f\": container with ID starting with 6052048d0b5be16c568290d732738ad49ed0563f14d731da05a511733f8ea56f not found: ID does not exist"
Sep 09 17:23:09.395107 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.395028    2559 scope.go:117] "RemoveContainer" containerID="84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"
Sep 09 17:23:09.395203 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.395187    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703"} err="failed to get container status \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": rpc error: code = NotFound desc = could not find container \"84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703\": container with ID starting with 84a77b124b941c60ddac7d846ec7476d968a0538d9ceca35a128dc50cf2ca703 not found: ID does not exist"
Sep 09 17:23:09.395243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.395203    2559 scope.go:117] "RemoveContainer" containerID="a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"
Sep 09 17:23:09.395460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.395444    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca"} err="failed to get container status \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": rpc error: code = NotFound desc = could not find container \"a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca\": container with ID starting with a08304e5e4b29e4b237d919ae12063ef79d6e0c4a8c5883359ecd6ad6f2d6dca not found: ID does not exist"
Sep 09 17:23:09.398909 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.398889    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:09.460999 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.460955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461146    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snlw\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-kube-api-access-6snlw\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461653 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.461653 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.461477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snlw\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-kube-api-access-6snlw\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562704    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.562819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.562711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.563411 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.563158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.563411 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.563277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.564066 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.564043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.564463 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.564443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.564905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.564884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.565490 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.565416    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b9afd4-e51f-4c20-bcbe-12b864186723-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.565490 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.565426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.565490 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.565478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.566064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.565920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.566446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.566418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.566541 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.566487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.566800 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.566781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b9afd4-e51f-4c20-bcbe-12b864186723-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.567369 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.567343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.567655 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.567637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.567765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.567748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.568436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.568415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.568516 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.568502    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.568987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.568946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b9afd4-e51f-4c20-bcbe-12b864186723-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.570120 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.570102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snlw\" (UniqueName: \"kubernetes.io/projected/91b9afd4-e51f-4c20-bcbe-12b864186723-kube-api-access-6snlw\") pod \"prometheus-k8s-0\" (UID: \"91b9afd4-e51f-4c20-bcbe-12b864186723\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.693231 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.693196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:09.970113 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:09.970087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 17:23:09.973447 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:23:09.973419    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b9afd4_e51f_4c20_bcbe_12b864186723.slice/crio-45326d976f73a731c4c290f477a3380a70876374deb5ba7006585b172e06c58d WatchSource:0}: Error finding container 45326d976f73a731c4c290f477a3380a70876374deb5ba7006585b172e06c58d: Status 404 returned error can't find the container with id 45326d976f73a731c4c290f477a3380a70876374deb5ba7006585b172e06c58d
Sep 09 17:23:10.332073 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:10.331986    2559 generic.go:356] "Generic (PLEG): container finished" podID="91b9afd4-e51f-4c20-bcbe-12b864186723" containerID="8ff5280a6c95509db9e2bfcd74ec8008e435d6b94a023fff126d6fa86b1b6c98" exitCode=0
Sep 09 17:23:10.332073 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:10.332038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerDied","Data":"8ff5280a6c95509db9e2bfcd74ec8008e435d6b94a023fff126d6fa86b1b6c98"}
Sep 09 17:23:10.332294 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:10.332112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"45326d976f73a731c4c290f477a3380a70876374deb5ba7006585b172e06c58d"}
Sep 09 17:23:11.053923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.053876    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80841726-7427-4b06-a816-dd2e3afb60ef" path="/var/lib/kubelet/pods/80841726-7427-4b06-a816-dd2e3afb60ef/volumes"
Sep 09 17:23:11.339458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"5a77d7e17688448ee389588458ce607698b31a1f9630814c5d42d4388c02c6c0"}
Sep 09 17:23:11.339458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"cc11c9ff85054d8fa936e629ad04f63ead3ad38663c296cd94119e5e6298c8cb"}
Sep 09 17:23:11.339680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"c64d22ff4901f1ddfa679aa15c50288c36cca859356c65877a7c6cb77e396e24"}
Sep 09 17:23:11.339680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"3ed017bf9d16e0f9e4abb7e785083b6acb865d50de560541aaba074f460a93de"}
Sep 09 17:23:11.339680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"f730815170d1a8c49e9f047015defcd1f6b3d83adb26df49f84b59da10721795"}
Sep 09 17:23:11.339680 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.339596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b9afd4-e51f-4c20-bcbe-12b864186723","Type":"ContainerStarted","Data":"f73f90538c29b7ec85f5368534815641020578fa2f6bb01a801cddf46bfd9546"}
Sep 09 17:23:11.395282 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:11.395219    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.376885853 podStartE2EDuration="2.395201974s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.316121ms" isStatefulPod=false podCreationTimestamp="2026-09-09 17:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:23:11.394098903 +0000 UTC m=+362.811696065" watchObservedRunningTime="2026-09-09 17:23:11.395201974 +0000 UTC m=+362.812799124"
Sep 09 17:23:12.626259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:12.626202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:12.730225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:12.730189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:14.694053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:14.694015    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:23:23.669137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:23.669105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:23.721329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:23.721300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:23.772600 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:23.772576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:57.050284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:57.050238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:23:57.103478 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:23:57.103445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:09.694315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:09.694275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:24:09.709780 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:09.709756    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:24:10.568187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:10.568160    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 17:24:18.752229 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:18.752197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:18.814578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:18.814549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:20.165656 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:20.165617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:20.273494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:20.273466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:20.374369 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:20.374348    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:21.134910 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:21.134873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:21.365011 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:21.364954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:30.694350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:30.694268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:30.797610 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:30.797580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:30.986114 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:30.986034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:31.086559 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:31.086530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:31.187613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:31.187581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:35.075933 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:35.075895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:35.174038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:35.174003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:35.409867 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:35.409790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:44.238404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:44.238364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:24:44.289078 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:24:44.289042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:26.270577 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:26.270542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:26.379336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:26.379303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:32.293100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:32.293063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:32.392662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:32.392629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:34.021932 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:34.021863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:25:34.121773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:25:34.121740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:00.714579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:00.714492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:01.520291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:01.520259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:04.333520 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:04.333483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:04.434195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:04.434162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:06.621151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:06.621115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:06.719339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:06.719303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:09.022647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:09.022618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:09.200078 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:09.200049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:12.118283 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:12.118249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:12.176655 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:12.176615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:16.609166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:16.609132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:17.063864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:17.063835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:17.123143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:17.123117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:29.882023 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:29.881986    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:29.973228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:29.973193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:34.007886 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:34.007851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:34.125574 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:34.125541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:38.107150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:38.107116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:38.668757 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:38.668715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:38.773728 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:38.773693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:41.379300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:41.379266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:49.067564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:49.067527    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:49.121507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:49.121463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:49.177003 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:49.176949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:53.281542 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.281498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:53.748822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.748785    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"]
Sep 09 17:26:53.752129 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.752108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.755773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.755748    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 17:26:53.755773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.755748    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 17:26:53.756000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.755752    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vq5nr\""
Sep 09 17:26:53.756000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.755752    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 17:26:53.756000 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.755877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 17:26:53.756127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.756024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 17:26:53.763498 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.763478    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"]
Sep 09 17:26:53.837185 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.837157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70e406f8-31ce-4f2b-b3f6-213d714f0e29-manager-config\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.837296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.837233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.837296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.837252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-metrics-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.837296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.837271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx59m\" (UniqueName: \"kubernetes.io/projected/70e406f8-31ce-4f2b-b3f6-213d714f0e29-kube-api-access-hx59m\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.937878 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.937837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.937878 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.937881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-metrics-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.938122 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.937906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx59m\" (UniqueName: \"kubernetes.io/projected/70e406f8-31ce-4f2b-b3f6-213d714f0e29-kube-api-access-hx59m\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.938122 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.937940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70e406f8-31ce-4f2b-b3f6-213d714f0e29-manager-config\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.938610 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.938587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70e406f8-31ce-4f2b-b3f6-213d714f0e29-manager-config\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.940530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.940510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-metrics-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.940614 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.940576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70e406f8-31ce-4f2b-b3f6-213d714f0e29-cert\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:53.958372 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:53.958343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx59m\" (UniqueName: \"kubernetes.io/projected/70e406f8-31ce-4f2b-b3f6-213d714f0e29-kube-api-access-hx59m\") pod \"lws-controller-manager-67d8946886-6lt68\" (UID: \"70e406f8-31ce-4f2b-b3f6-213d714f0e29\") " pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:54.061390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:54.061315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:54.335477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:54.335453    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"]
Sep 09 17:26:54.337669 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:26:54.337641    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e406f8_31ce_4f2b_b3f6_213d714f0e29.slice/crio-2a516ba268bcb8e9961fedb754abd44c141e8fc1adf6e1c66c8039447de67ba0 WatchSource:0}: Error finding container 2a516ba268bcb8e9961fedb754abd44c141e8fc1adf6e1c66c8039447de67ba0: Status 404 returned error can't find the container with id 2a516ba268bcb8e9961fedb754abd44c141e8fc1adf6e1c66c8039447de67ba0
Sep 09 17:26:54.339542 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:54.339528    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 17:26:54.772534 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:54.772496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:55.149424 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:55.149346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68" event={"ID":"70e406f8-31ce-4f2b-b3f6-213d714f0e29","Type":"ContainerStarted","Data":"2a516ba268bcb8e9961fedb754abd44c141e8fc1adf6e1c66c8039447de67ba0"}
Sep 09 17:26:56.393037 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:56.393001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:56.484289 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:56.484255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:56.983499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:56.983459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.158698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.158607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68" event={"ID":"70e406f8-31ce-4f2b-b3f6-213d714f0e29","Type":"ContainerStarted","Data":"855e4240646b0cb5a3b3a7e71c701735854c4899d0db0abbe1fe8636f6ded630"}
Sep 09 17:26:57.158859 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.158800    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:26:57.196545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.196491    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68" podStartSLOduration=1.662045057 podStartE2EDuration="4.196474784s" totalImagesPullingTime="2.534429727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:26:57.195147598 +0000 UTC m=+588.612744799" watchObservedRunningTime="2026-09-09 17:26:57.196474784 +0000 UTC m=+588.614071932"
Sep 09 17:26:57.256859 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.256828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.359413 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.359364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.416836 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.416812    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"]
Sep 09 17:26:57.420146 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.420129    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.423127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.423108    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 17:26:57.423235 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.423219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 17:26:57.423308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.423286    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 17:26:57.423567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.423550    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 17:26:57.423647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.423571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tsgcn\""
Sep 09 17:26:57.444388 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.444367    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"]
Sep 09 17:26:57.541948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.541912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.570328 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.570303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhv2h\" (UniqueName: \"kubernetes.io/projected/2d0a852f-5122-4510-a417-b640221f8469-kube-api-access-mhv2h\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.570425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.570338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.570487 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.570442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-tmp\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.570549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.570498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-manifests\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.570549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.570528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.641930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.641884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.671842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.671790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-tmp\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.671842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.671825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-manifests\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.671842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.671841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.672081 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.671860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhv2h\" (UniqueName: \"kubernetes.io/projected/2d0a852f-5122-4510-a417-b640221f8469-kube-api-access-mhv2h\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.672081 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.671885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.672295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.672274    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-manifests\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.674211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.674186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0a852f-5122-4510-a417-b640221f8469-tmp\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.674547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.674526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.674589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.674526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d0a852f-5122-4510-a417-b640221f8469-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.681153 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.681127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhv2h\" (UniqueName: \"kubernetes.io/projected/2d0a852f-5122-4510-a417-b640221f8469-kube-api-access-mhv2h\") pod \"opendatahub-operator-controller-manager-cdfc9465f-v2lpm\" (UID: \"2d0a852f-5122-4510-a417-b640221f8469\") " pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.730591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.730572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:26:57.742413 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.742379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.864901 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.864872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:57.998912 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:57.998831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:26:58.033417 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:58.033398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"]
Sep 09 17:26:58.035367 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:26:58.035339    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0a852f_5122_4510_a417_b640221f8469.slice/crio-79bb847ca8b30a2c76b255a81b628785061768219cda8766a3064c16284a440a WatchSource:0}: Error finding container 79bb847ca8b30a2c76b255a81b628785061768219cda8766a3064c16284a440a: Status 404 returned error can't find the container with id 79bb847ca8b30a2c76b255a81b628785061768219cda8766a3064c16284a440a
Sep 09 17:26:58.164523 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:26:58.164494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm" event={"ID":"2d0a852f-5122-4510-a417-b640221f8469","Type":"ContainerStarted","Data":"79bb847ca8b30a2c76b255a81b628785061768219cda8766a3064c16284a440a"}
Sep 09 17:27:02.185845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:02.185810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm" event={"ID":"2d0a852f-5122-4510-a417-b640221f8469","Type":"ContainerStarted","Data":"8f5bbc9a16f759ff4d50fad1aca0a39fc52af740f439fd01cffd259332709702"}
Sep 09 17:27:03.191731 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:03.191697    2559 generic.go:356] "Generic (PLEG): container finished" podID="2d0a852f-5122-4510-a417-b640221f8469" containerID="8f5bbc9a16f759ff4d50fad1aca0a39fc52af740f439fd01cffd259332709702" exitCode=0
Sep 09 17:27:03.192188 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:03.191788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm" event={"ID":"2d0a852f-5122-4510-a417-b640221f8469","Type":"ContainerDied","Data":"8f5bbc9a16f759ff4d50fad1aca0a39fc52af740f439fd01cffd259332709702"}
Sep 09 17:27:04.199791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:04.199756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm" event={"ID":"2d0a852f-5122-4510-a417-b640221f8469","Type":"ContainerStarted","Data":"32273208b7b9363c53f46e09c726af2dab8f215f0a93f267e75ef87b4d922eaf"}
Sep 09 17:27:04.200182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:04.199888    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:27:04.220457 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:04.220410    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm" podStartSLOduration=2.711354888 podStartE2EDuration="7.22039731s" totalImagesPullingTime="3.427856202s" totalInitContainerRuntime="1.08118622s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:26:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:27:04.21980756 +0000 UTC m=+595.637404708" watchObservedRunningTime="2026-09-09 17:27:04.22039731 +0000 UTC m=+595.637994457"
Sep 09 17:27:08.167223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:08.167191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67d8946886-6lt68"
Sep 09 17:27:09.004889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:09.004858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:27:09.005289 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:09.005264    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:27:09.594481 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:09.594441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:09.696121 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:09.696091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:15.206287 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:15.206258    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cdfc9465f-v2lpm"
Sep 09 17:27:16.779490 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:16.779457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:16.894309 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:16.894275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:17.205876 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:17.205840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:17.635831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:17.635738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:18.481192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:18.481162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:18.560582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:18.560548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:19.594101 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:19.594063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:23.875734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:23.875697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:23.976571 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:23.976538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:24.122064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.122032    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"]
Sep 09 17:27:24.129772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.129715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.132526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.132491    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 17:27:24.132625 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.132544    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wm7wt\""
Sep 09 17:27:24.138836 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.138811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"]
Sep 09 17:27:24.150059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.150032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:24.178211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178319 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/055b139b-632f-431f-928b-4b45b92de054-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178319 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178319 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178319 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/055b139b-632f-431f-928b-4b45b92de054-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrj9t\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-kube-api-access-wrj9t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178481 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178514 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.178549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.178528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.278979    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/055b139b-632f-431f-928b-4b45b92de054-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/055b139b-632f-431f-928b-4b45b92de054-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrj9t\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-kube-api-access-wrj9t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279604 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.279925 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.279903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.280255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.280237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/055b139b-632f-431f-928b-4b45b92de054-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.281717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.281692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/055b139b-632f-431f-928b-4b45b92de054-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.282332 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.282315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/055b139b-632f-431f-928b-4b45b92de054-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.292753 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.292735    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.293137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.293118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrj9t\" (UniqueName: \"kubernetes.io/projected/055b139b-632f-431f-928b-4b45b92de054-kube-api-access-wrj9t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88\" (UID: \"055b139b-632f-431f-928b-4b45b92de054\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.320418 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.320389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:24.442956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.442919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:24.621672 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.621641    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:24.718223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:24.718148    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"]
Sep 09 17:27:24.723006 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:27:24.722536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055b139b_632f_431f_928b_4b45b92de054.slice/crio-ea3ebef4216ffc00ac0ee58093bcae162c82ef70e52ce63ebb7dc9c1f7e0d02b WatchSource:0}: Error finding container ea3ebef4216ffc00ac0ee58093bcae162c82ef70e52ce63ebb7dc9c1f7e0d02b: Status 404 returned error can't find the container with id ea3ebef4216ffc00ac0ee58093bcae162c82ef70e52ce63ebb7dc9c1f7e0d02b
Sep 09 17:27:25.289885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:25.289850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88" event={"ID":"055b139b-632f-431f-928b-4b45b92de054","Type":"ContainerStarted","Data":"ea3ebef4216ffc00ac0ee58093bcae162c82ef70e52ce63ebb7dc9c1f7e0d02b"}
Sep 09 17:27:27.903024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.902991    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq4qp"]
Sep 09 17:27:27.905459 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.905440    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:27.908410 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.908392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8jn82\""
Sep 09 17:27:27.908515 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.908391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 17:27:27.914719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.914697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq4qp"]
Sep 09 17:27:27.924984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.924926    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:27:27.925069 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.925020    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:27:27.925069 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.925056    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:27:27.952405 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:27.952378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.010176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.010135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.010353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.010196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhvm\" (UniqueName: \"kubernetes.io/projected/2225faca-46d8-4547-8013-eff28b45e45f-kube-api-access-ffhvm\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.053254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.053149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.111095 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.111058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhvm\" (UniqueName: \"kubernetes.io/projected/2225faca-46d8-4547-8013-eff28b45e45f-kube-api-access-ffhvm\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.111286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.111180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.111349 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:27:28.111295    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 17:27:28.111405 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:27:28.111354    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert podName:2225faca-46d8-4547-8013-eff28b45e45f nodeName:}" failed. No retries permitted until 2026-09-09 17:27:28.611332945 +0000 UTC m=+620.028930075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert") pod "odh-model-controller-7998c67dc4-kq4qp" (UID: "2225faca-46d8-4547-8013-eff28b45e45f") : secret "odh-model-controller-webhook-cert" not found
Sep 09 17:27:28.119667 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.119631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhvm\" (UniqueName: \"kubernetes.io/projected/2225faca-46d8-4547-8013-eff28b45e45f-kube-api-access-ffhvm\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.153504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.153401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.254173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.254132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.307278 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.307242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88" event={"ID":"055b139b-632f-431f-928b-4b45b92de054","Type":"ContainerStarted","Data":"437b85e5b2cd4522c2e07e396fde13c2cb4896e36f89795daa00e9a93f74be05"}
Sep 09 17:27:28.324793 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.324728    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88" podStartSLOduration=1.126814603 podStartE2EDuration="4.324708002s" totalImagesPullingTime="3.197893399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:27:28.324433706 +0000 UTC m=+619.742030880" watchObservedRunningTime="2026-09-09 17:27:28.324708002 +0000 UTC m=+619.742305152"
Sep 09 17:27:28.417395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.417367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.423798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.423773    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcrpq"]
Sep 09 17:27:28.426267 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.426244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.428835 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.428814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ng7df\""
Sep 09 17:27:28.429107 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.428841    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 17:27:28.436649 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.436626    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcrpq"]
Sep 09 17:27:28.443389 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.443368    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:28.449135 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.449104    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:28.514874 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.514837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.515067 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.514898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhs8t\" (UniqueName: \"kubernetes.io/projected/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-kube-api-access-dhs8t\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.515681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.515651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:28.615812 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.615779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.615987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.615818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhs8t\" (UniqueName: \"kubernetes.io/projected/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-kube-api-access-dhs8t\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.615987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.615861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.618331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.618308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2225faca-46d8-4547-8013-eff28b45e45f-cert\") pod \"odh-model-controller-7998c67dc4-kq4qp\" (UID: \"2225faca-46d8-4547-8013-eff28b45e45f\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:28.618435 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.618344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.623280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.623262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhs8t\" (UniqueName: \"kubernetes.io/projected/db62dd4d-e49a-4dba-8ddb-7cc93e9f7182-kube-api-access-dhs8t\") pod \"model-serving-api-54d89bd5fc-fcrpq\" (UID: \"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.737025 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.736909    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:28.817199 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:28.817170    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:29.004209 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.004177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcrpq"]
Sep 09 17:27:29.006437 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:27:29.006409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb62dd4d_e49a_4dba_8ddb_7cc93e9f7182.slice/crio-e226e3fa1d347aef26f8279e50ee8fcd8db8bca3eb7e2ead9b36497efea75fa8 WatchSource:0}: Error finding container e226e3fa1d347aef26f8279e50ee8fcd8db8bca3eb7e2ead9b36497efea75fa8: Status 404 returned error can't find the container with id e226e3fa1d347aef26f8279e50ee8fcd8db8bca3eb7e2ead9b36497efea75fa8
Sep 09 17:27:29.083415 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.083389    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq4qp"]
Sep 09 17:27:29.085873 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:27:29.085847    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2225faca_46d8_4547_8013_eff28b45e45f.slice/crio-3c93fcd679a20e20dda69544cc6cf9357b90270ade7c575c8b6bc9edfa2cdb27 WatchSource:0}: Error finding container 3c93fcd679a20e20dda69544cc6cf9357b90270ade7c575c8b6bc9edfa2cdb27: Status 404 returned error can't find the container with id 3c93fcd679a20e20dda69544cc6cf9357b90270ade7c575c8b6bc9edfa2cdb27
Sep 09 17:27:29.312388 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.312297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp" event={"ID":"2225faca-46d8-4547-8013-eff28b45e45f","Type":"ContainerStarted","Data":"3c93fcd679a20e20dda69544cc6cf9357b90270ade7c575c8b6bc9edfa2cdb27"}
Sep 09 17:27:29.313462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.313431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq" event={"ID":"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182","Type":"ContainerStarted","Data":"e226e3fa1d347aef26f8279e50ee8fcd8db8bca3eb7e2ead9b36497efea75fa8"}
Sep 09 17:27:29.313649 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.313631    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:29.314711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.314690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88"
Sep 09 17:27:29.341051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.340945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:29.396401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:29.396371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:30.469497 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:30.469202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:30.521658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:30.521624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:33.337129 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.337088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq" event={"ID":"db62dd4d-e49a-4dba-8ddb-7cc93e9f7182","Type":"ContainerStarted","Data":"88450cbe5fa9db42d468db7665e05d48867bb8b7618dd9441f7e4b26b16729f7"}
Sep 09 17:27:33.337591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.337210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:27:33.338647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.338623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp" event={"ID":"2225faca-46d8-4547-8013-eff28b45e45f","Type":"ContainerStarted","Data":"b22857687c541a09d3e10456b0bf917e7f8aed2b68603859920374a2bd6b1e0b"}
Sep 09 17:27:33.338773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.338757    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:33.357199 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.357159    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq" podStartSLOduration=1.4796819399999999 podStartE2EDuration="5.357146349s" totalImagesPullingTime="3.877464409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:27:33.355137461 +0000 UTC m=+624.772734621" watchObservedRunningTime="2026-09-09 17:27:33.357146349 +0000 UTC m=+624.774743495"
Sep 09 17:27:33.372585 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:33.372544    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp" podStartSLOduration=2.528289737 podStartE2EDuration="6.372530711s" totalImagesPullingTime="3.844240974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:27:33.371508867 +0000 UTC m=+624.789106039" watchObservedRunningTime="2026-09-09 17:27:33.372530711 +0000 UTC m=+624.790127859"
Sep 09 17:27:34.294625 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.294591    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"]
Sep 09 17:27:34.297908 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.297889    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.300567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.300545    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 17:27:34.300567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.300556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 17:27:34.300759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.300585    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 17:27:34.300759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.300654    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wdxr9\""
Sep 09 17:27:34.313265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.313245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"]
Sep 09 17:27:34.365237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a346c65-5567-4fd2-9714-fa88c3d60645-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdhpr\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-kube-api-access-sdhpr\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.365592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.365426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.465942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.465910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a346c65-5567-4fd2-9714-fa88c3d60645-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466084 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.465948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466146 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdhpr\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-kube-api-access-sdhpr\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466346 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.466401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.467026 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.466949    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.468445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.468417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.468445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.468433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a346c65-5567-4fd2-9714-fa88c3d60645-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.468578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.468505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.469664 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.469649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a346c65-5567-4fd2-9714-fa88c3d60645-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.474076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.474052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.474745 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.474729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdhpr\" (UniqueName: \"kubernetes.io/projected/1a346c65-5567-4fd2-9714-fa88c3d60645-kube-api-access-sdhpr\") pod \"istiod-openshift-gateway-5677ccb49b-d8d5h\" (UID: \"1a346c65-5567-4fd2-9714-fa88c3d60645\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.608050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.607977    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:34.884526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:34.884434    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"]
Sep 09 17:27:34.888495 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:27:34.888466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a346c65_5567_4fd2_9714_fa88c3d60645.slice/crio-21576d7d56e159a7cf7d5f22a36dd3d8c360afd3be8e00c344917aed1561bc1d WatchSource:0}: Error finding container 21576d7d56e159a7cf7d5f22a36dd3d8c360afd3be8e00c344917aed1561bc1d: Status 404 returned error can't find the container with id 21576d7d56e159a7cf7d5f22a36dd3d8c360afd3be8e00c344917aed1561bc1d
Sep 09 17:27:35.352014 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:35.351979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h" event={"ID":"1a346c65-5567-4fd2-9714-fa88c3d60645","Type":"ContainerStarted","Data":"21576d7d56e159a7cf7d5f22a36dd3d8c360afd3be8e00c344917aed1561bc1d"}
Sep 09 17:27:37.156541 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.156412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:37.290465 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.290312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:37.445936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.445901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:37.490178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.490144    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:27:37.490268 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.490210    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:27:37.595746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:37.595710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:38.370506 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.370469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h" event={"ID":"1a346c65-5567-4fd2-9714-fa88c3d60645","Type":"ContainerStarted","Data":"4fc04a4a4cb00252b6ad55c6b25ed5e9dc45ff9686e00a0f9759c8b697fd87c7"}
Sep 09 17:27:38.370985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.370646    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:38.372364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.372333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h"
Sep 09 17:27:38.391819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.391763    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-d8d5h" podStartSLOduration=1.792722707 podStartE2EDuration="4.391750979s" totalImagesPullingTime="2.599028272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:27:38.38980509 +0000 UTC m=+629.807402241" watchObservedRunningTime="2026-09-09 17:27:38.391750979 +0000 UTC m=+629.809348128"
Sep 09 17:27:38.495215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.495177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:38.625953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:38.625868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:27:44.346692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:44.346661    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kq4qp"
Sep 09 17:27:44.348806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:27:44.348781    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fcrpq"
Sep 09 17:28:03.513978 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:03.513924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:28.962836 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:28.962801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:29.056187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:29.056156    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:42.749929 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:42.749893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:45.359085 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:45.359052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:45.757652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:45.757613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:46.173384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:46.173353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:48.597955 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:48.597917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:49.352286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:49.352257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:49.645321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:49.645227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:49.774284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:49.774252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:49.870659 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:49.870628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:51.252229 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:51.252193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:51.355535 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:51.355501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:52.431266 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:52.431227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:52.612732 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:52.612691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:55.362723 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:55.362691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:55.463167 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:55.463127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:56.196669 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:56.196639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:56.566227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:56.566140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.159946 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.159909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.273919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.273881    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.554803 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.554766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.655560 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.655520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.755449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.755415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:28:59.820973 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:28:59.820883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:07.824530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:07.824496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:07.933120 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:07.933084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:10.282462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:10.282414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:10.385008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:10.384947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:14.604992 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:14.604940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:14.705224 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:14.705171    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:18.420290 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:18.420254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:18.515266 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:18.515225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:18.616105 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:18.616064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:18.691932 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:18.691856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:19.613327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:19.613280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:19.710764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:19.710735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:20.144419 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:20.144386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:20.282173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:20.282142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:28.850341 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:28.850291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:28.916446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:28.916415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:31.321596 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:31.321559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:31.384651 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:31.384617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:36.615644 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:36.615602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:36.767602 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:36.767571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:48.877049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:48.877016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:49.064451 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:49.064414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:49.165090 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:49.165001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:49.719201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:49.719170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:29:49.822374 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:29:49.822339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:07.764307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:07.764270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:07.874010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:07.873950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:08.277868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:08.277826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:20.232436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:20.232394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:20.811298 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:20.811261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:26.730208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:26.730169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:26.920595 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:26.920555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:27.014791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:27.014701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:30.460787 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:30.460691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:30:30.559145 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:30:30.559109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:02.380886 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:02.380837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:02.614387 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:02.614357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:03.885763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.885731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:03.943344 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.943314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:03.947386 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.947360    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:31:03.950706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.950688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:03.953045 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.953020    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 17:31:03.953341 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.953325    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 17:31:03.953415 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.953388    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 17:31:03.954204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.954189    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 17:31:03.954291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.954219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bxbtq\""
Sep 09 17:31:03.960368 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:03.960349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:31:04.115700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.115668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.115868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.115705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rljz6\" (UniqueName: \"kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.115868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.115754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.115868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.115800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.216547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.216518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.216719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.216581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.216719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.216600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rljz6\" (UniqueName: \"kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.216719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.216623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.216719 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:31:04.216688    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 09 17:31:04.216953 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:31:04.216759    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls podName:e845f788-e9f1-47bf-838a-bb80b8957d4e nodeName:}" failed. No retries permitted until 2026-09-09 17:31:04.716736912 +0000 UTC m=+836.134334044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls") pod "maas-api-8458467cb6-6jpd6" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e") : secret "maas-api-serving-cert" not found
Sep 09 17:31:04.216953 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:31:04.216813    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 09 17:31:04.216953 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:31:04.216884    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs podName:e845f788-e9f1-47bf-838a-bb80b8957d4e nodeName:}" failed. No retries permitted until 2026-09-09 17:31:04.716865999 +0000 UTC m=+836.134463148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs") pod "maas-api-8458467cb6-6jpd6" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e") : secret "maas-api-metrics-tls" not found
Sep 09 17:31:04.217353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.217332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.224767 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.224746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rljz6\" (UniqueName: \"kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.454028 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.453979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:04.558476 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.558391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:04.628411 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.628379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:04.720121 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.720089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.720270 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.720141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.722438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.722411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.722552 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.722468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") pod \"maas-api-8458467cb6-6jpd6\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") " pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:04.862922 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:04.862837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:05.136118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:05.136093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:31:05.138244 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:31:05.138218    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode845f788_e9f1_47bf_838a_bb80b8957d4e.slice/crio-d53af281fc9557c663aa15e5225eb6b9ddaff82d2a9d39c8bdc18556f6b24816 WatchSource:0}: Error finding container d53af281fc9557c663aa15e5225eb6b9ddaff82d2a9d39c8bdc18556f6b24816: Status 404 returned error can't find the container with id d53af281fc9557c663aa15e5225eb6b9ddaff82d2a9d39c8bdc18556f6b24816
Sep 09 17:31:05.237797 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:05.237763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" event={"ID":"e845f788-e9f1-47bf-838a-bb80b8957d4e","Type":"ContainerStarted","Data":"d53af281fc9557c663aa15e5225eb6b9ddaff82d2a9d39c8bdc18556f6b24816"}
Sep 09 17:31:08.254805 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:08.254773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" event={"ID":"e845f788-e9f1-47bf-838a-bb80b8957d4e","Type":"ContainerStarted","Data":"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"}
Sep 09 17:31:08.255250 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:08.254901    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:08.272607 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:08.272563    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" podStartSLOduration=2.847951956 podStartE2EDuration="5.272550643s" totalImagesPullingTime="2.424598687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:31:08.271187602 +0000 UTC m=+839.688784763" watchObservedRunningTime="2026-09-09 17:31:08.272550643 +0000 UTC m=+839.690147792"
Sep 09 17:31:14.264279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:14.264253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:31:15.224730 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:15.224690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:15.325359 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:15.325293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:26.016856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:26.016822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:34.079169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.079135    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"]
Sep 09 17:31:34.082309 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.082287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.084689 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.084666    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 17:31:34.084815 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.084688    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 17:31:34.085626 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.085598    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7dhnx\""
Sep 09 17:31:34.085722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.085663    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 17:31:34.092660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.092640    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"]
Sep 09 17:31:34.117187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.117149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:34.165032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.164996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.165173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.165035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.165173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.165067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.165173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.165101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47s2r\" (UniqueName: \"kubernetes.io/projected/f8a68861-2ecc-4a06-9789-57157f6c24b6-kube-api-access-47s2r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.165173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.165135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.165382 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.165239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a68861-2ecc-4a06-9789-57157f6c24b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266322 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a68861-2ecc-4a06-9789-57157f6c24b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47s2r\" (UniqueName: \"kubernetes.io/projected/f8a68861-2ecc-4a06-9789-57157f6c24b6-kube-api-access-47s2r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.266776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.266750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.267040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.267017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.267673 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.267648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.269871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.269842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a68861-2ecc-4a06-9789-57157f6c24b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.270009 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.269924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a68861-2ecc-4a06-9789-57157f6c24b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.275792 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.275762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47s2r\" (UniqueName: \"kubernetes.io/projected/f8a68861-2ecc-4a06-9789-57157f6c24b6-kube-api-access-47s2r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9wnxn\" (UID: \"f8a68861-2ecc-4a06-9789-57157f6c24b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.394145 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.394063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:34.665022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:34.664993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"]
Sep 09 17:31:34.667458 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:31:34.667432    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a68861_2ecc_4a06_9789_57157f6c24b6.slice/crio-e223d12dd332984756dd121ddd66fbe106395c909a7ce65a5d1410193b11794a WatchSource:0}: Error finding container e223d12dd332984756dd121ddd66fbe106395c909a7ce65a5d1410193b11794a: Status 404 returned error can't find the container with id e223d12dd332984756dd121ddd66fbe106395c909a7ce65a5d1410193b11794a
Sep 09 17:31:35.375874 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:35.375840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn" event={"ID":"f8a68861-2ecc-4a06-9789-57157f6c24b6","Type":"ContainerStarted","Data":"e223d12dd332984756dd121ddd66fbe106395c909a7ce65a5d1410193b11794a"}
Sep 09 17:31:36.381542 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:36.381502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn" event={"ID":"f8a68861-2ecc-4a06-9789-57157f6c24b6","Type":"ContainerStarted","Data":"aa59c735cca7bd387ae0291b8352ad967533a097d6f8911a56a0a41284315c4e"}
Sep 09 17:31:36.400322 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:36.400270    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn" podStartSLOduration=1.326636507 podStartE2EDuration="2.400251608s" totalImagesPullingTime="1.073615101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:31:36.398283578 +0000 UTC m=+867.815880814" watchObservedRunningTime="2026-09-09 17:31:36.400251608 +0000 UTC m=+867.817848759"
Sep 09 17:31:40.886221 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:40.886187    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"]
Sep 09 17:31:40.892546 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:40.892467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:40.895080 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:40.895056    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 17:31:40.899544 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:40.899525    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"]
Sep 09 17:31:40.920536 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:40.920507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:41.026016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.025982    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k6x2\" (UniqueName: \"kubernetes.io/projected/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-kube-api-access-2k6x2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.026194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.026021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.026194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.026060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.026194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.026177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.026360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.026212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.026360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.026247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126691 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k6x2\" (UniqueName: \"kubernetes.io/projected/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-kube-api-access-2k6x2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.126847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.126816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.127222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.127192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.127222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.127216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.127383 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.127277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.129140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.129116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.129432 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.129412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.135098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.135077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k6x2\" (UniqueName: \"kubernetes.io/projected/65ddba0b-ae42-45ec-bb66-f8464c0dd3f4-kube-api-access-2k6x2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r\" (UID: \"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.204144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.204111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:41.489845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:41.489818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"]
Sep 09 17:31:41.492529 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:31:41.492502    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ddba0b_ae42_45ec_bb66_f8464c0dd3f4.slice/crio-2c7d9bccb1305926ddb6289598264990b179a753006c568e80dcea00763a4c12 WatchSource:0}: Error finding container 2c7d9bccb1305926ddb6289598264990b179a753006c568e80dcea00763a4c12: Status 404 returned error can't find the container with id 2c7d9bccb1305926ddb6289598264990b179a753006c568e80dcea00763a4c12
Sep 09 17:31:42.408275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:42.408243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r" event={"ID":"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4","Type":"ContainerStarted","Data":"a933147067bd883194d080a5b13f0f67417b202e0acf721382f4cb79a562aa22"}
Sep 09 17:31:42.408652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:42.408291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r" event={"ID":"65ddba0b-ae42-45ec-bb66-f8464c0dd3f4","Type":"ContainerStarted","Data":"2c7d9bccb1305926ddb6289598264990b179a753006c568e80dcea00763a4c12"}
Sep 09 17:31:42.428037 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:42.427985    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r" podStartSLOduration=2.226097657 podStartE2EDuration="2.427951486s" totalImagesPullingTime="201.853829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:31:42.426651595 +0000 UTC m=+873.844248745" watchObservedRunningTime="2026-09-09 17:31:42.427951486 +0000 UTC m=+873.845548634"
Sep 09 17:31:44.394559 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:44.394529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:44.394923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:44.394601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:44.406634 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:44.406612    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:44.429051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:44.429030    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9wnxn"
Sep 09 17:31:50.515877 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:50.515843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:31:51.204219 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:51.204180    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:51.204401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:51.204247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:51.216742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:51.216715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:31:51.460468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:31:51.460386    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r"
Sep 09 17:32:02.233590 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:02.233505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:32:06.069706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:06.069672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:32:09.033323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:09.033290    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:32:09.033791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:09.033639    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:32:13.332151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:13.332113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:32:20.614115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:32:20.614078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:25.238060 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:25.238022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:33.133303 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:33.133219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:33.233069 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:33.233031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:43.508456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:43.508420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:43.601363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:43.601330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:44.635364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:44.635330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:33:44.735032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:33:44.735003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:01.327796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.327764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:01.468464 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.468425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:01.539755 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.539723    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:34:01.542259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.542236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.544663 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.544640    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ea996c-openshift-default-dockercfg-tfb8k\""
Sep 09 17:34:01.554456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.554432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:34:01.594704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.594588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:01.598849 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.598821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.598989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.598861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.598989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.598893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.598989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.598943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.599157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.599035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.599157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.599062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.599157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.599089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.599157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.599136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.599307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.599216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qrq\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700469 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.700822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qrq\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.701057 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.700858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.701224 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.701200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.701422 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.701403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.701623 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.701600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.701781 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.701761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.703010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.702992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.703521 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.703499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.711842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.711816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.712307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.712281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qrq\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq\") pod \"e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") " pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.854820 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.854731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:01.920895 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:01.920849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:02.131310 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.131284    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:34:02.133420 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:02.133392    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba1b036_d379_4d60_86df_c7df6ee93051.slice/crio-dd208f65c1ab4a4b3accc3f14f2bdf44c868eb36ec97010e24d86c9ccfbe695f WatchSource:0}: Error finding container dd208f65c1ab4a4b3accc3f14f2bdf44c868eb36ec97010e24d86c9ccfbe695f: Status 404 returned error can't find the container with id dd208f65c1ab4a4b3accc3f14f2bdf44c868eb36ec97010e24d86c9ccfbe695f
Sep 09 17:34:02.135424 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.135395    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:02.135504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.135454    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:02.135504 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.135481    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:02.722144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.722114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:02.818943 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:02.818909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:03.039066 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.038982    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerStarted","Data":"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"}
Sep 09 17:34:03.039066 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.039036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerStarted","Data":"dd208f65c1ab4a4b3accc3f14f2bdf44c868eb36ec97010e24d86c9ccfbe695f"}
Sep 09 17:34:03.059912 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.059865    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podStartSLOduration=2.05985151 podStartE2EDuration="2.05985151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:03.057620202 +0000 UTC m=+1014.475217353" watchObservedRunningTime="2026-09-09 17:34:03.05985151 +0000 UTC m=+1014.477448659"
Sep 09 17:34:03.118740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.118705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:03.854935 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.854897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:03.860087 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:03.860063    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:04.043977 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:04.043939    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:04.044870 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:04.044849    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:04.989499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:04.989454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:05.088769 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:05.088740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.153835 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.153798    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:34:06.156270 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.156249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.158687 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.158668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ea996c-serving-cert\""
Sep 09 17:34:06.168630 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.168605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:34:06.186290 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.186267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.239622 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.239598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.239775 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.239651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.239775 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.239711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.239886 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.239779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvftk\" (UniqueName: \"kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.291714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.291678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.340863 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.340836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.341058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.340878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.341058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.340907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvftk\" (UniqueName: \"kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.341058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.340949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.341058 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:06.341022    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-serving-cert: secret "maas-api-e2e-inf-a-ea996c-serving-cert" not found
Sep 09 17:34:06.341299 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:06.341084    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls podName:9a0de804-d036-40c5-95b7-2946ca298576 nodeName:}" failed. No retries permitted until 2026-09-09 17:34:06.841066097 +0000 UTC m=+1018.258663225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls") pod "maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" (UID: "9a0de804-d036-40c5-95b7-2946ca298576") : secret "maas-api-e2e-inf-a-ea996c-serving-cert" not found
Sep 09 17:34:06.341796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.341775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.343583 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.343558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.351981 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.351934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvftk\" (UniqueName: \"kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.453675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.453638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.656359 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.656332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.790773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.790691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:06.846446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.846421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:06.848929 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:06.848901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:07.069477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:07.069395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:07.339051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:07.338907    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:34:07.342546 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:07.342518    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0de804_d036_40c5_95b7_2946ca298576.slice/crio-07fdbad982ee4419e823883500d8207d30c9d4f756c7ac23e6a7ac45bb562a8d WatchSource:0}: Error finding container 07fdbad982ee4419e823883500d8207d30c9d4f756c7ac23e6a7ac45bb562a8d: Status 404 returned error can't find the container with id 07fdbad982ee4419e823883500d8207d30c9d4f756c7ac23e6a7ac45bb562a8d
Sep 09 17:34:07.344301 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:07.344283    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 17:34:08.061674 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:08.061639    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" event={"ID":"9a0de804-d036-40c5-95b7-2946ca298576","Type":"ContainerStarted","Data":"07fdbad982ee4419e823883500d8207d30c9d4f756c7ac23e6a7ac45bb562a8d"}
Sep 09 17:34:08.959281 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:08.959244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:09.018100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.018067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:09.067160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.067129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" event={"ID":"9a0de804-d036-40c5-95b7-2946ca298576","Type":"ContainerStarted","Data":"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"}
Sep 09 17:34:09.067325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.067181    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:09.086002 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.085940    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" podStartSLOduration=2.096017908 podStartE2EDuration="3.085927095s" totalImagesPullingTime="989.909187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:09.084198108 +0000 UTC m=+1020.501795254" watchObservedRunningTime="2026-09-09 17:34:09.085927095 +0000 UTC m=+1020.503524244"
Sep 09 17:34:09.233333 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.233218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:09.453691 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.453645    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:34:09.456765 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.456745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.459276 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.459253    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-399f043b-openshift-default-dockercfg-7w7dg\""
Sep 09 17:34:09.468893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.468850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:34:09.482440 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.482416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:09.571863 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.571776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572045 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.571923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td778\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572045 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.571985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572165 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572165 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572317 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.572317 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.572285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673584 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td778\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673584 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673950 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.673950 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.673845    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.674147 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.674104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.674204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.674153    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.675681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.675664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.676272 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.676250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.681057 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.681034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.681139 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.681104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td778\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778\") pod \"e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") " pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:09.767498 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:09.767470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:10.040312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.040284    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:34:10.042928 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:10.042888    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2585c90_9f8c_484e_a47b_b545ee018aa0.slice/crio-062853687ae7b66306fc8b39d7f8c9c872ffca660b94c81aa59e24a5ea67cabe WatchSource:0}: Error finding container 062853687ae7b66306fc8b39d7f8c9c872ffca660b94c81aa59e24a5ea67cabe: Status 404 returned error can't find the container with id 062853687ae7b66306fc8b39d7f8c9c872ffca660b94c81aa59e24a5ea67cabe
Sep 09 17:34:10.046362 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.046306    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:10.046472 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.046407    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:10.046472 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.046452    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:10.072700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.072668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerStarted","Data":"062853687ae7b66306fc8b39d7f8c9c872ffca660b94c81aa59e24a5ea67cabe"}
Sep 09 17:34:10.121438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:10.119439    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:11.078324 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.078246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerStarted","Data":"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"}
Sep 09 17:34:11.100688 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.100637    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podStartSLOduration=2.100619999 podStartE2EDuration="2.100619999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:11.098690028 +0000 UTC m=+1022.516287177" watchObservedRunningTime="2026-09-09 17:34:11.100619999 +0000 UTC m=+1022.518217148"
Sep 09 17:34:11.598270 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.598238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:11.768125 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.768088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:11.773403 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.773378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:11.970558 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:11.970526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:12.084198 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:12.084166    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:12.085108 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:12.085088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:12.411639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:12.411556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:12.506523 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:12.506492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:13.547366 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.547329    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:13.550447 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.550427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.552734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.552714    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-399f043b-serving-cert\""
Sep 09 17:34:13.561886 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.561862    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:13.611760 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.611729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.611917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.611778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.611917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.611877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.612062 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.611979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6mf\" (UniqueName: \"kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.658660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.658624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:13.713465 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.713432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6mf\" (UniqueName: \"kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.713643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.713498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.713643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.713534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.713643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.713603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.713813 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:13.713725    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-serving-cert: secret "maas-api-e2e-ait-399f043b-serving-cert" not found
Sep 09 17:34:13.713813 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:13.713792    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls podName:8df1d6d7-9a7c-4803-baf4-aab17ae2a562 nodeName:}" failed. No retries permitted until 2026-09-09 17:34:14.213774694 +0000 UTC m=+1025.631371821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls") pod "maas-api-e2e-ait-399f043b-58db98df45-jt85t" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562") : secret "maas-api-e2e-ait-399f043b-serving-cert" not found
Sep 09 17:34:13.714221 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.714195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.716348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.716325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.722478 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.722456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6mf\" (UniqueName: \"kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:13.758835 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:13.758808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:14.051139 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.051103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:14.161166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.161136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:14.219287 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.219255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:14.219441 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:14.219422    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-serving-cert: secret "maas-api-e2e-ait-399f043b-serving-cert" not found
Sep 09 17:34:14.219529 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:14.219500    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls podName:8df1d6d7-9a7c-4803-baf4-aab17ae2a562 nodeName:}" failed. No retries permitted until 2026-09-09 17:34:15.219480723 +0000 UTC m=+1026.637077852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls") pod "maas-api-e2e-ait-399f043b-58db98df45-jt85t" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562") : secret "maas-api-e2e-ait-399f043b-serving-cert" not found
Sep 09 17:34:14.361404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.361317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:14.861785 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.861755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:14.985007 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:14.984943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:15.078402 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:15.078373    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:34:15.228787 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:15.228749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:15.231339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:15.231315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"maas-api-e2e-ait-399f043b-58db98df45-jt85t\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:15.363381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:15.363338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:15.661345 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:15.661320    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:15.663557 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:15.663530    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df1d6d7_9a7c_4803_baf4_aab17ae2a562.slice/crio-5dcb906ef8f6a17bf36ec882feea151afa80b68a80690c9f42fe428cfbc9f1dd WatchSource:0}: Error finding container 5dcb906ef8f6a17bf36ec882feea151afa80b68a80690c9f42fe428cfbc9f1dd: Status 404 returned error can't find the container with id 5dcb906ef8f6a17bf36ec882feea151afa80b68a80690c9f42fe428cfbc9f1dd
Sep 09 17:34:16.109475 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.109434    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" event={"ID":"8df1d6d7-9a7c-4803-baf4-aab17ae2a562","Type":"ContainerStarted","Data":"5dcb906ef8f6a17bf36ec882feea151afa80b68a80690c9f42fe428cfbc9f1dd"}
Sep 09 17:34:16.146923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.146898    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:34:16.149194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.149171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.151684 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.151660    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-37448c-serving-cert\""
Sep 09 17:34:16.163778 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.163757    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:34:16.209999 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.209640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:16.239287 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.239262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.239438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.239393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rw4b\" (UniqueName: \"kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.239438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.239422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.239513 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.239468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.340826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.340735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rw4b\" (UniqueName: \"kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.340826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.340788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.340826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.340816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.341170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.340849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.341232 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:16.341173    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-37448c-serving-cert: secret "maas-api-e2e-autores-37448c-serving-cert" not found
Sep 09 17:34:16.341284 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:16.341237    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls podName:a9d1e8ed-9803-49cf-971a-982e9a3986ec nodeName:}" failed. No retries permitted until 2026-09-09 17:34:16.841217195 +0000 UTC m=+1028.258814341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls") pod "maas-api-e2e-autores-37448c-5959b84775-pfjlp" (UID: "a9d1e8ed-9803-49cf-971a-982e9a3986ec") : secret "maas-api-e2e-autores-37448c-serving-cert" not found
Sep 09 17:34:16.341688 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.341662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.342360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.342291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:16.344126 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.344104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.349187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.349164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rw4b\" (UniqueName: \"kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.659467 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.659386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:16.800989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.800418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:16.845016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.844981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:16.847782 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:16.847760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") pod \"maas-api-e2e-autores-37448c-5959b84775-pfjlp\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:17.062920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:17.062887    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:17.116708 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:17.116592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" event={"ID":"8df1d6d7-9a7c-4803-baf4-aab17ae2a562","Type":"ContainerStarted","Data":"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"}
Sep 09 17:34:17.117069 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:17.116717    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:17.134578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:17.134517    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" podStartSLOduration=3.742982612 podStartE2EDuration="4.134500937s" totalImagesPullingTime="391.518325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:17.134013858 +0000 UTC m=+1028.551611008" watchObservedRunningTime="2026-09-09 17:34:17.134500937 +0000 UTC m=+1028.552098089"
Sep 09 17:34:17.364724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:17.364289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:34:17.367024 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:17.366989    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d1e8ed_9803_49cf_971a_982e9a3986ec.slice/crio-52c33f4413c29b220f47f09d9a1fc13b3ef32a67943906b05685698fcc01ad5f WatchSource:0}: Error finding container 52c33f4413c29b220f47f09d9a1fc13b3ef32a67943906b05685698fcc01ad5f: Status 404 returned error can't find the container with id 52c33f4413c29b220f47f09d9a1fc13b3ef32a67943906b05685698fcc01ad5f
Sep 09 17:34:18.123306 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:18.123252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" event={"ID":"a9d1e8ed-9803-49cf-971a-982e9a3986ec","Type":"ContainerStarted","Data":"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"}
Sep 09 17:34:18.123702 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:18.123359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" event={"ID":"a9d1e8ed-9803-49cf-971a-982e9a3986ec","Type":"ContainerStarted","Data":"52c33f4413c29b220f47f09d9a1fc13b3ef32a67943906b05685698fcc01ad5f"}
Sep 09 17:34:18.140908 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:18.140856    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" podStartSLOduration=1.5617834099999999 podStartE2EDuration="2.140841917s" totalImagesPullingTime="579.058507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:18.138737539 +0000 UTC m=+1029.556334689" watchObservedRunningTime="2026-09-09 17:34:18.140841917 +0000 UTC m=+1029.558439066"
Sep 09 17:34:19.128586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:19.128554    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:20.151885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:20.151803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:20.316420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:20.316383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:20.409525 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:20.409431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:20.509889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:20.509850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:23.128904 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.128829    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:23.149065 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.149035    2559 generic.go:356] "Generic (PLEG): container finished" podID="bba1b036-d379-4d60-86df-c7df6ee93051" containerID="417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8" exitCode=0
Sep 09 17:34:23.149218 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.149113    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerDied","Data":"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"}
Sep 09 17:34:23.149530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.149513    2559 scope.go:117] "RemoveContainer" containerID="417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"
Sep 09 17:34:23.150624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.150593    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:23.150724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.150669    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:23.150789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.150724    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:23.244326 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:23.244302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:24.155945 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:24.155910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerStarted","Data":"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"}
Sep 09 17:34:24.855161 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:24.855113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:24.855405 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:24.855378    2559 patch_prober.go:28] interesting pod/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 09 17:34:24.855451 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:24.855436    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 09 17:34:25.093883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:25.093849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:25.139329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:25.139250    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:34:25.855705 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:25.855668    2559 patch_prober.go:28] interesting pod/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 09 17:34:25.856121 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:25.855724    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 09 17:34:26.855915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:26.855851    2559 patch_prober.go:28] interesting pod/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 09 17:34:26.856399 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:26.855928    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 09 17:34:27.155423 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:27.155332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:27.855496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:27.855460    2559 patch_prober.go:28] interesting pod/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 09 17:34:27.855695 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:27.855579    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 09 17:34:28.856123 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:28.856077    2559 patch_prober.go:28] interesting pod/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 09 17:34:28.856515 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:28.856148    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 09 17:34:29.859569 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:29.859523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:29.860089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:29.859807    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:29.860456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:29.860437    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:34:29.892499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:29.892443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:30.237007 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:30.236972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:30.534192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:30.534096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:30.696038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:30.696004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:32.195541 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.195512    2559 generic.go:356] "Generic (PLEG): container finished" podID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerID="c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596" exitCode=0
Sep 09 17:34:32.196024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.195592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerDied","Data":"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"}
Sep 09 17:34:32.196024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.196004    2559 scope.go:117] "RemoveContainer" containerID="c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"
Sep 09 17:34:32.197238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.197207    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:32.197312 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.197289    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:32.197353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:32.197338    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:33.203789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:33.203750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerStarted","Data":"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"}
Sep 09 17:34:33.767918 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:33.767879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:33.768142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:33.768122    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:33.768189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:33.768170    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:34.003550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:34.003515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:34.105118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:34.105025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:34.768885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:34.768848    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:34.769261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:34.768915    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:35.263216 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.263182    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:34:35.265950 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.265930    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.268201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.268180    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-53da12-serving-cert\""
Sep 09 17:34:35.276479 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.276457    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:34:35.299985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.297670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:35.358147 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.358115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:35.363288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.363257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.363396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.363329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.363396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.363362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.363396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.363381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4wk\" (UniqueName: \"kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.463939 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.463907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.464150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.464032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.464150 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:35.464076    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-serving-cert: secret "maas-api-e2e-inf-b-53da12-serving-cert" not found
Sep 09 17:34:35.464150 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:35.464147    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls podName:684e1f25-b868-4879-b090-063f9eaacc85 nodeName:}" failed. No retries permitted until 2026-09-09 17:34:35.964131908 +0000 UTC m=+1047.381729034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls") pod "maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" (UID: "684e1f25-b868-4879-b090-063f9eaacc85") : secret "maas-api-e2e-inf-b-53da12-serving-cert" not found
Sep 09 17:34:35.464327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.464084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.464327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.464213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4wk\" (UniqueName: \"kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.464699 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.464678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.466643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.466621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.473632 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.473611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4wk\" (UniqueName: \"kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.643634 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.643524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:35.767863 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.767830    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:35.768075 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.767882    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:35.921546 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.921515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:35.970010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.969945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:35.972365 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:35.972341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") pod \"maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:36.005995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.002458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:36.178893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.178819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:36.374825 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.374779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:36.467732 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.467708    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:34:36.469656 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:36.469615    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e1f25_b868_4879_b090_063f9eaacc85.slice/crio-c204dd6e8768a700152d17a842ce09ed21e11215e1f270cd64be22bea0211d16 WatchSource:0}: Error finding container c204dd6e8768a700152d17a842ce09ed21e11215e1f270cd64be22bea0211d16: Status 404 returned error can't find the container with id c204dd6e8768a700152d17a842ce09ed21e11215e1f270cd64be22bea0211d16
Sep 09 17:34:36.768726 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.768641    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:36.768726 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:36.768695    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:37.181336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:37.181245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:37.225694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:37.225658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" event={"ID":"684e1f25-b868-4879-b090-063f9eaacc85","Type":"ContainerStarted","Data":"c204dd6e8768a700152d17a842ce09ed21e11215e1f270cd64be22bea0211d16"}
Sep 09 17:34:37.768893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:37.768867    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:37.769007 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:37.768917    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:37.798814 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:37.798778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:38.231944 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.231877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" event={"ID":"684e1f25-b868-4879-b090-063f9eaacc85","Type":"ContainerStarted","Data":"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"}
Sep 09 17:34:38.231944 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.231947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:38.251546 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.251497    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" podStartSLOduration=1.9913901379999999 podStartE2EDuration="3.251472335s" totalImagesPullingTime="1.260082197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:38.249387684 +0000 UTC m=+1049.666984832" watchObservedRunningTime="2026-09-09 17:34:38.251472335 +0000 UTC m=+1049.669069484"
Sep 09 17:34:38.550696 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.550616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:38.768256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.768225    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 09 17:34:38.768444 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:38.768278    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 09 17:34:39.270507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:39.270475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:39.773128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:39.773099    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:39.773518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:39.773497    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:39.774245 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:39.774221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:34:39.794904 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:39.794878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:42.647431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:42.647402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:43.399182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:43.399135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:43.500435 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:43.500400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:44.244320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:44.244295    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:34:48.712777 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:48.712735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:48.813046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:48.813010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:49.794564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:49.794518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:49.894362 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:49.894326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:53.784480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:53.784447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.355129 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.355099    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:54.355318 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.355292    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" podUID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" containerName="maas-api" containerID="cri-o://fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca" gracePeriod=30
Sep 09 17:34:54.389432 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.389406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.489602 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.489537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.553447 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.553403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.607274 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.607213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.611446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.611428    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:54.678134 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.678099    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:34:54.679587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.679552    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" containerID="cri-o://55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed" gracePeriod=30
Sep 09 17:34:54.702354 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.702314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:54.759725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.759698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs\") pod \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") "
Sep 09 17:34:54.759936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.759768    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") pod \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") "
Sep 09 17:34:54.759936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.759822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca\") pod \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") "
Sep 09 17:34:54.759936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.759927    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf6mf\" (UniqueName: \"kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf\") pod \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\" (UID: \"8df1d6d7-9a7c-4803-baf4-aab17ae2a562\") "
Sep 09 17:34:54.760225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.760198    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8df1d6d7-9a7c-4803-baf4-aab17ae2a562" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:34:54.760357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.760331    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-openshift-service-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:34:54.762176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.762149    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8df1d6d7-9a7c-4803-baf4-aab17ae2a562" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:34:54.762284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.762217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf" (OuterVolumeSpecName: "kube-api-access-nf6mf") pod "8df1d6d7-9a7c-4803-baf4-aab17ae2a562" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562"). InnerVolumeSpecName "kube-api-access-nf6mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:34:54.762435 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.762413    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8df1d6d7-9a7c-4803-baf4-aab17ae2a562" (UID: "8df1d6d7-9a7c-4803-baf4-aab17ae2a562"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:34:54.777159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.776602    2559 patch_prober.go:28] interesting pod/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 17:34:54.777159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.776661    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:34:54.861433 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.861355    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf6mf\" (UniqueName: \"kubernetes.io/projected/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-kube-api-access-nf6mf\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:34:54.861433 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.861380    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-metrics-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:34:54.861433 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:54.861389    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1d6d7-9a7c-4803-baf4-aab17ae2a562-maas-api-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:34:55.139902 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.139826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.238225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.238193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.315423 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.315387    2559 generic.go:356] "Generic (PLEG): container finished" podID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" containerID="fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca" exitCode=0
Sep 09 17:34:55.315586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.315443    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"
Sep 09 17:34:55.315586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.315439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" event={"ID":"8df1d6d7-9a7c-4803-baf4-aab17ae2a562","Type":"ContainerDied","Data":"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"}
Sep 09 17:34:55.315586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.315565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t" event={"ID":"8df1d6d7-9a7c-4803-baf4-aab17ae2a562","Type":"ContainerDied","Data":"5dcb906ef8f6a17bf36ec882feea151afa80b68a80690c9f42fe428cfbc9f1dd"}
Sep 09 17:34:55.315711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.315591    2559 scope.go:117] "RemoveContainer" containerID="fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"
Sep 09 17:34:55.324294 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.324275    2559 scope.go:117] "RemoveContainer" containerID="fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"
Sep 09 17:34:55.324569 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:34:55.324552    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca\": container with ID starting with fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca not found: ID does not exist" containerID="fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"
Sep 09 17:34:55.324622 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.324579    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca"} err="failed to get container status \"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca\": rpc error: code = NotFound desc = could not find container \"fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca\": container with ID starting with fbd1e4c4fede485dd056be9643eadb351c62cb0bdcc6098cb55360c136d827ca not found: ID does not exist"
Sep 09 17:34:55.334915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.334894    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:55.338412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.338391    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-399f043b-58db98df45-jt85t"]
Sep 09 17:34:55.355186 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.355159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.455111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.455085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.509408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.509377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.623488 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.623462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:34:55.623986 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.623949    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" containerName="maas-api"
Sep 09 17:34:55.623986 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.623986    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" containerName="maas-api"
Sep 09 17:34:55.624138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.624053    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" containerName="maas-api"
Sep 09 17:34:55.626686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.626664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.629421 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.629405    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1277f005-gw-openshift-default-dockercfg-w5gkp\""
Sep 09 17:34:55.640183 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.640160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:34:55.651178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.651147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:55.770989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.770881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.770989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.770920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.770989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.770940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771227 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771208    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771368 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6ggr\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.771368 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.771301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.872683 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872645    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6ggr\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.872988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873577 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.873429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873577 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.873456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.873574    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.873669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.873704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.873695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.875199 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.875172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.875589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.875573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.881489 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.881468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6ggr\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.881489 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.881483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token\") pod \"e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") " pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:55.937878 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:55.937846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:56.031587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.031515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:56.211640 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.211613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:34:56.213875 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:34:56.213846    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31106b5_1c7b_4030_8781_17f878886b6b.slice/crio-5000bcaa091bff14b0689fb75c5fae8295cecce363c6f09f0f812911bdab6d96 WatchSource:0}: Error finding container 5000bcaa091bff14b0689fb75c5fae8295cecce363c6f09f0f812911bdab6d96: Status 404 returned error can't find the container with id 5000bcaa091bff14b0689fb75c5fae8295cecce363c6f09f0f812911bdab6d96
Sep 09 17:34:56.216215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.216179    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:56.216308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.216248    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:56.216308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.216277    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:34:56.323783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.323695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerStarted","Data":"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"}
Sep 09 17:34:56.323783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.323759    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerStarted","Data":"5000bcaa091bff14b0689fb75c5fae8295cecce363c6f09f0f812911bdab6d96"}
Sep 09 17:34:56.342183 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.342130    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podStartSLOduration=1.342113796 podStartE2EDuration="1.342113796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:34:56.340388338 +0000 UTC m=+1067.757985479" watchObservedRunningTime="2026-09-09 17:34:56.342113796 +0000 UTC m=+1067.759710944"
Sep 09 17:34:56.938613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:56.938578    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:57.054746 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:57.054708    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df1d6d7-9a7c-4803-baf4-aab17ae2a562" path="/var/lib/kubelet/pods/8df1d6d7-9a7c-4803-baf4-aab17ae2a562/volumes"
Sep 09 17:34:57.566067 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:57.566032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:57.885366 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:57.885261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:57.944028 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:57.943995    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:57.948697 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:57.948668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.185733 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.185693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.286025 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.285990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.334224 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.334190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:58.335624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.335604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:34:58.476292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.476203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.740734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.740634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.840883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.840846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:58.992582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:58.992467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:34:59.940645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:34:59.940618    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:35:00.116180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116095    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td778\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116162    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116192    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.116737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116548    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:00.116737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.117034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116763    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.117034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:35:00.117034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:00.117034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116827    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs\") pod \"f2585c90-9f8c-484e-a47b-b545ee018aa0\" (UID: \"f2585c90-9f8c-484e-a47b-b545ee018aa0\") "
Sep 09 17:35:00.117034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.116832    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:00.117456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117042    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:00.117534 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117514    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.117605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117542    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.117605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117557    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.117605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117570    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.117605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.117594    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2585c90-9f8c-484e-a47b-b545ee018aa0-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.118803 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.118779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:35:00.118803 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.118784    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:35:00.118991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.118811    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778" (OuterVolumeSpecName: "kube-api-access-td778") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "kube-api-access-td778". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:35:00.118991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.118894    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2585c90-9f8c-484e-a47b-b545ee018aa0" (UID: "f2585c90-9f8c-484e-a47b-b545ee018aa0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:00.218425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.218384    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td778\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-kube-api-access-td778\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.218425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.218419    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.218645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.218435    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.218645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.218448    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2585c90-9f8c-484e-a47b-b545ee018aa0-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:00.345397 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.345364    2559 generic.go:356] "Generic (PLEG): container finished" podID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerID="55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed" exitCode=0
Sep 09 17:35:00.345545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.345418    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"
Sep 09 17:35:00.345545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.345452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerDied","Data":"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"}
Sep 09 17:35:00.345545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.345509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd" event={"ID":"f2585c90-9f8c-484e-a47b-b545ee018aa0","Type":"ContainerDied","Data":"062853687ae7b66306fc8b39d7f8c9c872ffca660b94c81aa59e24a5ea67cabe"}
Sep 09 17:35:00.345545 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.345538    2559 scope.go:117] "RemoveContainer" containerID="55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"
Sep 09 17:35:00.355058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.355042    2559 scope.go:117] "RemoveContainer" containerID="c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"
Sep 09 17:35:00.363010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.362991    2559 scope.go:117] "RemoveContainer" containerID="55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"
Sep 09 17:35:00.363257 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:35:00.363237    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed\": container with ID starting with 55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed not found: ID does not exist" containerID="55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"
Sep 09 17:35:00.363321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.363265    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed"} err="failed to get container status \"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed\": rpc error: code = NotFound desc = could not find container \"55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed\": container with ID starting with 55cebd5de9548c22cbdfc2b562fea8ab10cd8f57af633896a954df57db1fe6ed not found: ID does not exist"
Sep 09 17:35:00.363321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.363282    2559 scope.go:117] "RemoveContainer" containerID="c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"
Sep 09 17:35:00.363516 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:35:00.363496    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596\": container with ID starting with c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596 not found: ID does not exist" containerID="c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"
Sep 09 17:35:00.363557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.363523    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596"} err="failed to get container status \"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596\": rpc error: code = NotFound desc = could not find container \"c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596\": container with ID starting with c828680e5524981e6e84505d27f10ffaa71ee05f85caac1b382d1ca668663596 not found: ID does not exist"
Sep 09 17:35:00.367876 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.367818    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:35:00.371474 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:00.371452    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-399f043b-openshift-default-58d9898cb8-59ncd"]
Sep 09 17:35:01.052773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:01.052737    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" path="/var/lib/kubelet/pods/f2585c90-9f8c-484e-a47b-b545ee018aa0/volumes"
Sep 09 17:35:01.179427 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:01.179396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:14.375100 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:14.375061    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 17:35:14.375589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:14.375122    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 17:35:16.433486 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.433454    2559 generic.go:356] "Generic (PLEG): container finished" podID="a31106b5-1c7b-4030-8781-17f878886b6b" containerID="14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8" exitCode=0
Sep 09 17:35:16.434005 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.433532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerDied","Data":"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"}
Sep 09 17:35:16.434123 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.434105    2559 scope.go:117] "RemoveContainer" containerID="14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"
Sep 09 17:35:16.435249 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.435220    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:16.435315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.435296    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:16.435352 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:16.435332    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:17.440071 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:17.440035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerStarted","Data":"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"}
Sep 09 17:35:17.938456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:17.938424    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:17.938689 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:17.938669    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 17:35:17.938735 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:17.938715    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 17:35:18.938768 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:18.938734    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 17:35:18.939198 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:18.938792    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 17:35:19.938425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:19.938387    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 17:35:19.938654 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:19.938451    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 17:35:20.938776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:20.938741    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 17:35:20.939201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:20.938801    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 17:35:21.944548 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:21.944489    2559 patch_prober.go:28] interesting pod/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 17:35:21.945028 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:21.944561    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 17:35:22.208617 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:22.208531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:22.942259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:22.942232    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:22.942531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:22.942500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:22.943240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:22.943222    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:29.210325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.210286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:29.511006 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.510899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:29.573753 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.573720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:29.674023 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.673992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:29.778708 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.778621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:29.825942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.825904    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:35:29.826512 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.826173    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy" containerID="cri-o://b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85" gracePeriod=30
Sep 09 17:35:29.851624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:29.851591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:30.132299 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.132200    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:30.278404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.278368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:30.558500 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.558466    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:35:30.559087 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.559068    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:35:30.559159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.559091    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:35:30.559159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.559103    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:35:30.559159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.559112    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:35:30.559320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.559232    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:35:30.561862 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.561841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.564405 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.564347    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-50082ca1-openshift-default-dockercfg-4pcbc\""
Sep 09 17:35:30.575509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.575470    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:35:30.584236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.584204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:30.635977 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.635934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636116 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.635992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjpnq\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636198 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.636366 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.636294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.712042 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.712009    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:30.736841 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.736812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.736948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.736897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.736948 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.736934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737044 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.736974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737044 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737044 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjpnq\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737357 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737530 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737745 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737745 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.737745 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.737759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.739446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.739423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.739548 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.739527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.747935 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.747916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjpnq\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.748700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.748682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token\") pod \"e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") " pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:30.876181 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:30.876106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:31.148816 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.148790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:35:31.150950 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:35:31.150918    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c72ec30_3860_40f7_adb3_2849fb243935.slice/crio-d01f15251c5e9e01ec68125478d5d372d7bf45fcd047956c7cc501d6ad61c29d WatchSource:0}: Error finding container d01f15251c5e9e01ec68125478d5d372d7bf45fcd047956c7cc501d6ad61c29d: Status 404 returned error can't find the container with id d01f15251c5e9e01ec68125478d5d372d7bf45fcd047956c7cc501d6ad61c29d
Sep 09 17:35:31.153798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.153765    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:31.153896 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.153839    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:31.153956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.153897    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:31.517403 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.517368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerStarted","Data":"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"}
Sep 09 17:35:31.517899 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.517428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerStarted","Data":"d01f15251c5e9e01ec68125478d5d372d7bf45fcd047956c7cc501d6ad61c29d"}
Sep 09 17:35:31.545716 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.545646    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podStartSLOduration=1.545627112 podStartE2EDuration="1.545627112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:35:31.543716819 +0000 UTC m=+1102.961313968" watchObservedRunningTime="2026-09-09 17:35:31.545627112 +0000 UTC m=+1102.963224262"
Sep 09 17:35:31.876532 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:31.876450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:32.870742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:32.870704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:32.881613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:32.881588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:32.977187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:32.977158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:33.526749 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:33.526718    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:33.527673 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:33.527654    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:34.051774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:34.051741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:34.152320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:34.152290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:34.400413 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:34.400335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:34.619416 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:34.619385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:34.691748 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:34.691711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:35.092191 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.092167    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:35.183819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183786    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6ggr\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183899    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.183934    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184013    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184097    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket\") pod \"a31106b5-1c7b-4030-8781-17f878886b6b\" (UID: \"a31106b5-1c7b-4030-8781-17f878886b6b\") "
Sep 09 17:35:35.184286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184106    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:35.184286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184229    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:35.184502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184412    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:35.184502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184427    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:35:35.184502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:35.184619 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184589    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.184619 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184607    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.184722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184626    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.184722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184643    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.184722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.184657    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31106b5-1c7b-4030-8781-17f878886b6b-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.186255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.186225    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:35:35.186255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.186230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr" (OuterVolumeSpecName: "kube-api-access-z6ggr") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "kube-api-access-z6ggr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:35:35.186445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.186432    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:35:35.186582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.186563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a31106b5-1c7b-4030-8781-17f878886b6b" (UID: "a31106b5-1c7b-4030-8781-17f878886b6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:35:35.285668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.285588    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6ggr\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-kube-api-access-z6ggr\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.285668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.285621    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31106b5-1c7b-4030-8781-17f878886b6b-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.285668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.285634    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31106b5-1c7b-4030-8781-17f878886b6b-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.285668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.285644    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31106b5-1c7b-4030-8781-17f878886b6b-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:35:35.538871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.538795    2559 generic.go:356] "Generic (PLEG): container finished" podID="a31106b5-1c7b-4030-8781-17f878886b6b" containerID="b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85" exitCode=0
Sep 09 17:35:35.538871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.538844    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"
Sep 09 17:35:35.539061 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.538874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerDied","Data":"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"}
Sep 09 17:35:35.539061 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.538928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk" event={"ID":"a31106b5-1c7b-4030-8781-17f878886b6b","Type":"ContainerDied","Data":"5000bcaa091bff14b0689fb75c5fae8295cecce363c6f09f0f812911bdab6d96"}
Sep 09 17:35:35.539061 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.538950    2559 scope.go:117] "RemoveContainer" containerID="b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"
Sep 09 17:35:35.548200 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.548183    2559 scope.go:117] "RemoveContainer" containerID="14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"
Sep 09 17:35:35.556464 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.556447    2559 scope.go:117] "RemoveContainer" containerID="b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"
Sep 09 17:35:35.556847 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:35:35.556820    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85\": container with ID starting with b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85 not found: ID does not exist" containerID="b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"
Sep 09 17:35:35.556893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.556862    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85"} err="failed to get container status \"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85\": rpc error: code = NotFound desc = could not find container \"b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85\": container with ID starting with b1a4ed1577bd689e7f6080427a1f1179af467299034683e2b16e513e6f441e85 not found: ID does not exist"
Sep 09 17:35:35.556893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.556888    2559 scope.go:117] "RemoveContainer" containerID="14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"
Sep 09 17:35:35.557222 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:35:35.557204    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8\": container with ID starting with 14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8 not found: ID does not exist" containerID="14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"
Sep 09 17:35:35.557278 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.557228    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8"} err="failed to get container status \"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8\": rpc error: code = NotFound desc = could not find container \"14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8\": container with ID starting with 14a7723cc943129c91e237d164f3419ff83027b573987002835264594c2337c8 not found: ID does not exist"
Sep 09 17:35:35.561198 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.561172    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:35:35.563796 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:35.563773    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1277f005-gw-openshift-default-86cd56dfdd-wb9nk"]
Sep 09 17:35:37.053173 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:37.053140    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" path="/var/lib/kubelet/pods/a31106b5-1c7b-4030-8781-17f878886b6b/volumes"
Sep 09 17:35:45.237654 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:45.237616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:56.648088 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.648054    2559 generic.go:356] "Generic (PLEG): container finished" podID="5c72ec30-3860-40f7-adb3-2849fb243935" containerID="83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e" exitCode=0
Sep 09 17:35:56.648492 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.648129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerDied","Data":"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"}
Sep 09 17:35:56.648539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.648497    2559 scope.go:117] "RemoveContainer" containerID="83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"
Sep 09 17:35:56.649543 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.649517    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:56.649615 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.649592    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:56.649656 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:56.649626    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:35:57.655810 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:57.655777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerStarted","Data":"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"}
Sep 09 17:35:57.706003 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:57.705946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:57.876856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:57.876818    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:35:57.877064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:57.877041    2559 patch_prober.go:28] interesting pod/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 17:35:57.877118 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:57.877094    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 17:35:58.876500 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:58.876466    2559 patch_prober.go:28] interesting pod/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 17:35:58.876985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:58.876527    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 17:35:58.877477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:58.877453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:35:59.876621 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:59.876584    2559 patch_prober.go:28] interesting pod/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 17:35:59.877084 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:35:59.876642    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 17:36:00.876584 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:00.876550    2559 patch_prober.go:28] interesting pod/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 17:36:00.876751 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:00.876607    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 17:36:01.876793 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:01.876762    2559 patch_prober.go:28] interesting pod/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 17:36:01.877178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:01.876816    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 17:36:02.880200 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:02.880169    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:36:02.880644 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:02.880462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:36:02.881096 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:02.881082    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:36:04.503489 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:04.503457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:04.603284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:04.603249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:04.686791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:04.686751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:04.746223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:04.746194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:05.790398 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:05.790349    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:36:05.790899 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:05.790676    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy" containerID="cri-o://99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839" gracePeriod=30
Sep 09 17:36:05.877676 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:05.877633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:06.246694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.246663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:06.536169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536091    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:06.536651 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536635    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:06.536701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536656    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:06.536701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536675    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:06.536701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536686    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:06.536809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536799    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2585c90-9f8c-484e-a47b-b545ee018aa0" containerName="istio-proxy"
Sep 09 17:36:06.536845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.536812    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:06.539243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.539222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.541675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.541656    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0aa81a54-openshift-default-dockercfg-4kc5t\""
Sep 09 17:36:06.550627 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.550604    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:06.561255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.561229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:06.694043 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbp5x\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.694425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.694413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795395 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbp5x\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.795903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.795831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.796503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.796228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.796503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.796234    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.796503 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.796289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.796681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.796650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.797917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.797894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.798201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.798181    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.804296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.804273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.804509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.804490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbp5x\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x\") pod \"e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") " pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.851714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.851690    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:06.889501 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:06.889418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:07.132940 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.132916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:07.134723 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:36:07.134694    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3812a3_9ba8_4435_9886_57795fbd8c20.slice/crio-838b18d5aa1a8a29b00e052d926508b0252762bf269af2068109a5e4abb9e790 WatchSource:0}: Error finding container 838b18d5aa1a8a29b00e052d926508b0252762bf269af2068109a5e4abb9e790: Status 404 returned error can't find the container with id 838b18d5aa1a8a29b00e052d926508b0252762bf269af2068109a5e4abb9e790
Sep 09 17:36:07.136888 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.136850    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:07.136954 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.136917    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:07.136954 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.136948    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:07.708466 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.708431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerStarted","Data":"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"}
Sep 09 17:36:07.708672 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.708482    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerStarted","Data":"838b18d5aa1a8a29b00e052d926508b0252762bf269af2068109a5e4abb9e790"}
Sep 09 17:36:07.729184 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.729139    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podStartSLOduration=1.72912493 podStartE2EDuration="1.72912493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:36:07.726463788 +0000 UTC m=+1139.144060938" watchObservedRunningTime="2026-09-09 17:36:07.72912493 +0000 UTC m=+1139.146722080"
Sep 09 17:36:07.852821 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.852788    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:07.968215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:07.968132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.390482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.390401    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:36:08.390682 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.390650    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" podUID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" containerName="maas-api" containerID="cri-o://975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b" gracePeriod=30
Sep 09 17:36:08.417377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.417346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.482549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.482511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.535721 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.535677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.601436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.601405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.650813 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.650742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:08.651582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.651565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:36:08.714578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.714547    2559 generic.go:356] "Generic (PLEG): container finished" podID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" containerID="975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b" exitCode=0
Sep 09 17:36:08.714717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.714591    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"
Sep 09 17:36:08.714717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.714630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" event={"ID":"a9d1e8ed-9803-49cf-971a-982e9a3986ec","Type":"ContainerDied","Data":"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"}
Sep 09 17:36:08.714717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.714678    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp" event={"ID":"a9d1e8ed-9803-49cf-971a-982e9a3986ec","Type":"ContainerDied","Data":"52c33f4413c29b220f47f09d9a1fc13b3ef32a67943906b05685698fcc01ad5f"}
Sep 09 17:36:08.714856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.714702    2559 scope.go:117] "RemoveContainer" containerID="975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"
Sep 09 17:36:08.723383 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.723367    2559 scope.go:117] "RemoveContainer" containerID="975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"
Sep 09 17:36:08.723635 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:36:08.723616    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b\": container with ID starting with 975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b not found: ID does not exist" containerID="975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"
Sep 09 17:36:08.723684 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.723642    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b"} err="failed to get container status \"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b\": rpc error: code = NotFound desc = could not find container \"975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b\": container with ID starting with 975de4dda866989f0efcea7f16dfe4523812b4649f164fadd7fd94d2c20b0d4b not found: ID does not exist"
Sep 09 17:36:08.818520 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.818490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") pod \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") "
Sep 09 17:36:08.818705 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.818539    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rw4b\" (UniqueName: \"kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b\") pod \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") "
Sep 09 17:36:08.818705 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.818599    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca\") pod \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") "
Sep 09 17:36:08.818705 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.818688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs\") pod \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\" (UID: \"a9d1e8ed-9803-49cf-971a-982e9a3986ec\") "
Sep 09 17:36:08.818978 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.818933    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9d1e8ed-9803-49cf-971a-982e9a3986ec" (UID: "a9d1e8ed-9803-49cf-971a-982e9a3986ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:36:08.819300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.819184    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d1e8ed-9803-49cf-971a-982e9a3986ec-openshift-service-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:08.820916 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.820883    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b" (OuterVolumeSpecName: "kube-api-access-2rw4b") pod "a9d1e8ed-9803-49cf-971a-982e9a3986ec" (UID: "a9d1e8ed-9803-49cf-971a-982e9a3986ec"). InnerVolumeSpecName "kube-api-access-2rw4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:36:08.820916 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.820897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9d1e8ed-9803-49cf-971a-982e9a3986ec" (UID: "a9d1e8ed-9803-49cf-971a-982e9a3986ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:36:08.821083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.820919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a9d1e8ed-9803-49cf-971a-982e9a3986ec" (UID: "a9d1e8ed-9803-49cf-971a-982e9a3986ec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:36:08.857011 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.856986    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:08.920035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.920009    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-maas-api-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:08.920035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.920033    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rw4b\" (UniqueName: \"kubernetes.io/projected/a9d1e8ed-9803-49cf-971a-982e9a3986ec-kube-api-access-2rw4b\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:08.920197 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:08.920043    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9d1e8ed-9803-49cf-971a-982e9a3986ec-metrics-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:09.040735 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.040706    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:36:09.044975 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.044931    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-37448c-5959b84775-pfjlp"]
Sep 09 17:36:09.054180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.054154    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" path="/var/lib/kubelet/pods/a9d1e8ed-9803-49cf-971a-982e9a3986ec/volumes"
Sep 09 17:36:09.719892 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.719858    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:09.720780 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.720762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:09.786776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.786746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:09.927513 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:09.927468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:10.190972 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:10.190937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:10.256310 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:10.256267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:10.431176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:10.431145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:10.677016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:10.676983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:10.747006 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:10.746978    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:11.037597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.037567    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:36:11.141217 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141223    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjpnq\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141384 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141387    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data\") pod \"5c72ec30-3860-40f7-adb3-2849fb243935\" (UID: \"5c72ec30-3860-40f7-adb3-2849fb243935\") "
Sep 09 17:36:11.141756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141673    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:11.141756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141680    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:11.141910 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141760    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:36:11.141910 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:11.142062 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.141940    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:11.142327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.142274    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.142327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.142297    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.142327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.142311    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.142327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.142324    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.142566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.142337    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c72ec30-3860-40f7-adb3-2849fb243935-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.143858 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.143824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:36:11.144154 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.144133    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:11.144345 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.144331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq" (OuterVolumeSpecName: "kube-api-access-mjpnq") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "kube-api-access-mjpnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:36:11.144408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.144347    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c72ec30-3860-40f7-adb3-2849fb243935" (UID: "5c72ec30-3860-40f7-adb3-2849fb243935"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:36:11.243578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.243436    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c72ec30-3860-40f7-adb3-2849fb243935-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.243578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.243474    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjpnq\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-kube-api-access-mjpnq\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.243578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.243488    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c72ec30-3860-40f7-adb3-2849fb243935-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.243578 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.243504    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c72ec30-3860-40f7-adb3-2849fb243935-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:11.730480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.730444    2559 generic.go:356] "Generic (PLEG): container finished" podID="5c72ec30-3860-40f7-adb3-2849fb243935" containerID="99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839" exitCode=0
Sep 09 17:36:11.730646 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.730498    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"
Sep 09 17:36:11.730646 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.730538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerDied","Data":"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"}
Sep 09 17:36:11.730646 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.730594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr" event={"ID":"5c72ec30-3860-40f7-adb3-2849fb243935","Type":"ContainerDied","Data":"d01f15251c5e9e01ec68125478d5d372d7bf45fcd047956c7cc501d6ad61c29d"}
Sep 09 17:36:11.730646 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.730622    2559 scope.go:117] "RemoveContainer" containerID="99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"
Sep 09 17:36:11.740172 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.740154    2559 scope.go:117] "RemoveContainer" containerID="83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"
Sep 09 17:36:11.748496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.747932    2559 scope.go:117] "RemoveContainer" containerID="99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"
Sep 09 17:36:11.748496 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:36:11.748265    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839\": container with ID starting with 99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839 not found: ID does not exist" containerID="99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"
Sep 09 17:36:11.748496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.748293    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839"} err="failed to get container status \"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839\": rpc error: code = NotFound desc = could not find container \"99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839\": container with ID starting with 99427c511c495efea3c950a92806ca0f1fcde372930d2e2ea9f4035de7399839 not found: ID does not exist"
Sep 09 17:36:11.748496 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.748308    2559 scope.go:117] "RemoveContainer" containerID="83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"
Sep 09 17:36:11.748766 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:36:11.748595    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e\": container with ID starting with 83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e not found: ID does not exist" containerID="83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"
Sep 09 17:36:11.748766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.748628    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e"} err="failed to get container status \"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e\": rpc error: code = NotFound desc = could not find container \"83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e\": container with ID starting with 83db79ace349906cdfb87b9ac3bdc565eb1ac6bcc22f33923aa47156ec96c29e not found: ID does not exist"
Sep 09 17:36:11.755215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.755188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:36:11.760036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:11.760004    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-50082ca1-openshift-default-7b8ff8ddfb-hd5cr"]
Sep 09 17:36:13.051927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:13.051897    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" path="/var/lib/kubelet/pods/5c72ec30-3860-40f7-adb3-2849fb243935/volumes"
Sep 09 17:36:13.978430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:13.978398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:25.359933 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:25.359899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:25.462244 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:25.462212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:28.169778 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:28.169741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:29.826528 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.826496    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerID="fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9" exitCode=0
Sep 09 17:36:29.826916 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.826571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerDied","Data":"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"}
Sep 09 17:36:29.827013 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.826998    2559 scope.go:117] "RemoveContainer" containerID="fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"
Sep 09 17:36:29.828035 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.828008    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:29.828102 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.828076    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:29.828149 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:29.828106    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:30.833024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:30.832988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerStarted","Data":"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"}
Sep 09 17:36:30.852038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:30.852006    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:30.852492 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:30.852395    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:30.852492 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:30.852466    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:31.043629 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:31.043585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:31.852368 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:31.852332    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:31.852779 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:31.852387    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:32.852776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:32.852743    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:32.853194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:32.852796    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:33.852323 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:33.852288    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:33.852509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:33.852343    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:34.852220 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:34.852184    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:34.852612 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:34.852235    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:35.852757 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:35.852703    2559 patch_prober.go:28] interesting pod/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 17:36:35.853311 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:35.852800    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 17:36:36.855988 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:36.855947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:36.856348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:36.856246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:36.857022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:36.857003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:37.178391 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:37.178359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.189872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.189834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.667970 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.667937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.729267 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.729233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.829766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.829726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.920894 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.920794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:40.977921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.977877    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:40.978191 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.978161    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy" containerID="cri-o://e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490" gracePeriod=30
Sep 09 17:36:40.993160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:40.993134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:41.642365 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:41.642321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:41.741469 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:41.741433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:41.840947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:41.840912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:43.181254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:43.181223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:46.234660 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.234636    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:46.379580 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379504    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379580 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379545    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379580 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbp5x\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379759    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo\") pod \"ee3812a3-9ba8-4435-9886-57795fbd8c20\" (UID: \"ee3812a3-9ba8-4435-9886-57795fbd8c20\") "
Sep 09 17:36:46.379864 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.379932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.380026    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.380088    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.380103    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.380123    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:36:46.380247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.380166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:46.381941 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.381917    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:36:46.382140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.382117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:36:46.382140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.382123    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x" (OuterVolumeSpecName: "kube-api-access-hbp5x") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "kube-api-access-hbp5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:36:46.382266 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.382185    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee3812a3-9ba8-4435-9886-57795fbd8c20" (UID: "ee3812a3-9ba8-4435-9886-57795fbd8c20"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:36:46.481250 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481223    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481250 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481245    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481256    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3812a3-9ba8-4435-9886-57795fbd8c20-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481271    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481279    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481287    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3812a3-9ba8-4435-9886-57795fbd8c20-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.481400 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.481294    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbp5x\" (UniqueName: \"kubernetes.io/projected/ee3812a3-9ba8-4435-9886-57795fbd8c20-kube-api-access-hbp5x\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:36:46.908425 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.908382    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerID="e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490" exitCode=0
Sep 09 17:36:46.908621 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.908431    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"
Sep 09 17:36:46.908621 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.908461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerDied","Data":"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"}
Sep 09 17:36:46.908621 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.908553    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt" event={"ID":"ee3812a3-9ba8-4435-9886-57795fbd8c20","Type":"ContainerDied","Data":"838b18d5aa1a8a29b00e052d926508b0252762bf269af2068109a5e4abb9e790"}
Sep 09 17:36:46.908621 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.908583    2559 scope.go:117] "RemoveContainer" containerID="e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"
Sep 09 17:36:46.919174 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.919154    2559 scope.go:117] "RemoveContainer" containerID="fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"
Sep 09 17:36:46.927630 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.927606    2559 scope.go:117] "RemoveContainer" containerID="e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"
Sep 09 17:36:46.928620 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:36:46.928572    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490\": container with ID starting with e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490 not found: ID does not exist" containerID="e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"
Sep 09 17:36:46.928620 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.928607    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490"} err="failed to get container status \"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490\": rpc error: code = NotFound desc = could not find container \"e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490\": container with ID starting with e8a4f0d0a66d496da1f182d81570149a2dc1b267842283e68fa278417aed6490 not found: ID does not exist"
Sep 09 17:36:46.928806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.928628    2559 scope.go:117] "RemoveContainer" containerID="fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"
Sep 09 17:36:46.928954 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:36:46.928924    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9\": container with ID starting with fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9 not found: ID does not exist" containerID="fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"
Sep 09 17:36:46.929087 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.928986    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9"} err="failed to get container status \"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9\": rpc error: code = NotFound desc = could not find container \"fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9\": container with ID starting with fb6560faa00a60bc3f3b57197de81b275a0e31b1ee8ad4aa2bfc5b8a16d72ce9 not found: ID does not exist"
Sep 09 17:36:46.930539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.930517    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:46.933689 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:46.933668    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0aa81a54-openshift-default-c45cd59b8-mkpxt"]
Sep 09 17:36:47.052553 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:47.052522    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" path="/var/lib/kubelet/pods/ee3812a3-9ba8-4435-9886-57795fbd8c20/volumes"
Sep 09 17:36:48.793704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:48.793671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:48.855675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:48.855632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:48.938417 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:48.938380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:49.038304 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:49.038274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:49.139066 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:49.138954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:49.466381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:49.466350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:52.134236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:52.134203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:53.920575 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:53.920538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:56.148160 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:56.148119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:56.406644 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:56.406552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:56.857366 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:56.857331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:57.135327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135235    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:36:57.135675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135648    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:36:57.135675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135665    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:36:57.135675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135673    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:36:57.135675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135694    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" containerName="maas-api"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135699    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" containerName="maas-api"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135706    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135711    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135791    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31106b5-1c7b-4030-8781-17f878886b6b" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135799    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135807    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:36:57.135872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.135813    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d1e8ed-9803-49cf-971a-982e9a3986ec" containerName="maas-api"
Sep 09 17:36:57.140110 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.140088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.142937 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.142913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-95cd01-openshift-default-dockercfg-25wcx\""
Sep 09 17:36:57.148614 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.148507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:36:57.156377 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.156354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:57.180012 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.179987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2d6g\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.180339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.180236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.257770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.257727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:36:57.280891 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.280858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.280891 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.280896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.280935    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.280955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2d6g\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281406 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281534 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281640 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281852 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.281852 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.281812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.284022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.283997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.284214 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.284194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.290479 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.290451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2d6g\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.290652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.290631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token\") pod \"e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") " pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.455314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.455278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:57.732171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.732144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:36:57.734235 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:36:57.734209    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ec417d_1da2_4d03_ab16_5a8be736ec18.slice/crio-07c4318aea123f8d6f78a49fcf4d7a99a33cf86fda265f221e2a8e98328d8654 WatchSource:0}: Error finding container 07c4318aea123f8d6f78a49fcf4d7a99a33cf86fda265f221e2a8e98328d8654: Status 404 returned error can't find the container with id 07c4318aea123f8d6f78a49fcf4d7a99a33cf86fda265f221e2a8e98328d8654
Sep 09 17:36:57.736694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.736664    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:57.736763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.736727    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:57.736799 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.736760    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:36:57.966343 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.966307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerStarted","Data":"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"}
Sep 09 17:36:57.966516 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.966369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerStarted","Data":"07c4318aea123f8d6f78a49fcf4d7a99a33cf86fda265f221e2a8e98328d8654"}
Sep 09 17:36:57.984926 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:57.984819    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podStartSLOduration=0.984802491 podStartE2EDuration="984.802491ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:36:57.983217404 +0000 UTC m=+1189.400814554" watchObservedRunningTime="2026-09-09 17:36:57.984802491 +0000 UTC m=+1189.402399642"
Sep 09 17:36:58.455470 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:58.455438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:58.460637 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:58.460613    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:58.970880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:58.970843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:36:58.971676 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:36:58.971655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:37:00.031067 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:00.031018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:00.384564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:00.384469    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:01.182113 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:01.182084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:01.282642 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:01.282613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:01.698196 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:01.698167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:01.766485 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:01.766446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:06.042177 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:06.042138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:08.286856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:08.286809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:09.062547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:09.062511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:37:09.064379 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:09.064354    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:37:11.908569 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:11.908532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:15.012156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:15.012116    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 17:37:15.012586 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:15.012200    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 17:37:15.365337 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:15.365268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:16.053274 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.053246    2559 generic.go:356] "Generic (PLEG): container finished" podID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerID="5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694" exitCode=0
Sep 09 17:37:16.053657 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.053322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerDied","Data":"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"}
Sep 09 17:37:16.053734 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.053717    2559 scope.go:117] "RemoveContainer" containerID="5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"
Sep 09 17:37:16.054819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.054775    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:37:16.054879 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.054866    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:37:16.054918 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:16.054905    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:37:17.059495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:17.059461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerStarted","Data":"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"}
Sep 09 17:37:17.455468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:17.455432    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:37:17.455659 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:17.455635    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 09 17:37:17.455718 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:17.455699    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 09 17:37:18.455844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:18.455811    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 09 17:37:18.456229 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:18.455869    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 09 17:37:19.456348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:19.456315    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 09 17:37:19.456720 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:19.456367    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 09 17:37:20.455709 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:20.455677    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 09 17:37:20.455883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:20.455733    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 09 17:37:21.456569 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:21.456530    2559 patch_prober.go:28] interesting pod/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 09 17:37:21.456944 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:21.456594    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 09 17:37:21.711086 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:21.710991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:21.812655 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:21.812622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:21.911913 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:21.911877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:22.460830 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:22.460794    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:37:22.461692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:22.461663    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:37:22.462406 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:22.462376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:37:23.942977 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:23.942919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:24.916799 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:24.916759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:37.772288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:37.772256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:43.475458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:43.475420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:43.575952 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:43.575922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:43.671203 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:43.671158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:46.717344 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:46.717312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:54.154241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:54.154211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:37:54.934528 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:37:54.934493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:00.748643 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:00.748555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:00.887403 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:00.887365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:01.003911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:01.003821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:01.559927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:01.559898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:01.659359 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:01.659324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:01.757415 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:01.757380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:03.242570 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:03.242535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:08.914192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:08.914156    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:09.014314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:09.014282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:09.562909 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:09.562871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:13.893996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:13.893957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:15.414498 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.414467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:15.474027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.473989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:15.636257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.636216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:15.911784 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.911753    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:38:15.912190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.912173    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:38:15.912263 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.912192    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:38:15.912325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.912264    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c72ec30-3860-40f7-adb3-2849fb243935" containerName="istio-proxy"
Sep 09 17:38:15.912325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.912272    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3812a3-9ba8-4435-9886-57795fbd8c20" containerName="istio-proxy"
Sep 09 17:38:15.915428 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.915408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.917955 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.917938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-71f58f92-openshift-default-dockercfg-q9qr6\""
Sep 09 17:38:15.927083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.927050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:38:15.938507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.938467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:15.952838 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.952804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.952984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.952852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.952984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.952872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.952984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.952897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.952984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.952929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5std\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.953232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.953028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.953232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.953055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.953232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.953088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:15.953232 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:15.953133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.051336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.051303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:16.054495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054611 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054611 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054611 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054611 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.054807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5std\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.055089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.055089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.054986    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.055189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.055172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.055295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.055213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.055514 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.055332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.056998 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.056979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.057344 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.057325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.064032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.064013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5std\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.064109 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.064053    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token\") pod \"e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") " pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.228050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.228018    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:16.501761 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.501738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:38:16.503916 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:38:16.503884    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79399d43_ec05_4bd9_918c_62db3567c020.slice/crio-a2fac89325025e1cbcfa70169d8eb5cf607fa61f0b9a9be4f3a6e0b7558d9246 WatchSource:0}: Error finding container a2fac89325025e1cbcfa70169d8eb5cf607fa61f0b9a9be4f3a6e0b7558d9246: Status 404 returned error can't find the container with id a2fac89325025e1cbcfa70169d8eb5cf607fa61f0b9a9be4f3a6e0b7558d9246
Sep 09 17:38:16.506254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.506220    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:16.506336 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.506287    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:16.506376 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:16.506343    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:17.337722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:17.337688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerStarted","Data":"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"}
Sep 09 17:38:17.337893 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:17.337738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerStarted","Data":"a2fac89325025e1cbcfa70169d8eb5cf607fa61f0b9a9be4f3a6e0b7558d9246"}
Sep 09 17:38:18.228996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:18.228947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:18.233903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:18.233880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:18.255822 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:18.255771    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podStartSLOduration=3.255754632 podStartE2EDuration="3.255754632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:38:17.379993158 +0000 UTC m=+1268.797590306" watchObservedRunningTime="2026-09-09 17:38:18.255754632 +0000 UTC m=+1269.673351783"
Sep 09 17:38:18.342779 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:18.342749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:18.343795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:18.343769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:19.265126 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:19.265073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:19.364288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:19.364256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:20.392628 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:20.392582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:20.494898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:20.494865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:20.604929 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:20.604873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:21.313092 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:21.313053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:21.414327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:21.414298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:24.271237 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:24.271204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:24.676608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:24.676577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:24.748072 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:24.748029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:24.808668 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:24.808638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:25.020777 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:25.020690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:25.081328 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:25.081295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:25.277468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:25.277386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:30.910698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:30.910661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:31.165622 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:31.165591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:31.266200 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:31.266164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:31.428605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:31.428515    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:38:31.428831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:31.428798    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy" containerID="cri-o://919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da" gracePeriod=30
Sep 09 17:38:31.452983 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:31.452867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:32.823275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:32.823240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:32.935793 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:32.935753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:33.950764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:33.950729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:34.337942 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:34.337853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:34.384109 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:34.384082    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 17:38:34.392445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:34.384146    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 17:38:34.439932 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:34.439887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:35.438399 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.438365    2559 generic.go:356] "Generic (PLEG): container finished" podID="79399d43-ec05-4bd9-918c-62db3567c020" containerID="375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc" exitCode=0
Sep 09 17:38:35.438816 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.438414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerDied","Data":"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"}
Sep 09 17:38:35.438816 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.438802    2559 scope.go:117] "RemoveContainer" containerID="375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"
Sep 09 17:38:35.439855 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.439824    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:35.439911 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.439897    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:35.439947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:35.439931    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:38:36.451421 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.451389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerStarted","Data":"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"}
Sep 09 17:38:36.728285 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.728257    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:38:36.864842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.864802    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.864850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.864895    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.864938    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865049 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2d6g\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865094    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865118    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865201    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865224    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:36.865288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865265    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert\") pod \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\" (UID: \"f3ec417d-1da2-4d03-ab16-5a8be736ec18\") "
Sep 09 17:38:36.865663 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865410    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:36.865663 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865591    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:38:36.865774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865711    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.865774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865734    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.866070 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865844    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.866070 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865917    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.866070 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.865929    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.867489 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.867465    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:38:36.867601 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.867540    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:38:36.867878 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.867858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:36.868094 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.868074    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g" (OuterVolumeSpecName: "kube-api-access-g2d6g") pod "f3ec417d-1da2-4d03-ab16-5a8be736ec18" (UID: "f3ec417d-1da2-4d03-ab16-5a8be736ec18"). InnerVolumeSpecName "kube-api-access-g2d6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:38:36.967111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.967034    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.967111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.967060    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.967111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.967069    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2d6g\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-kube-api-access-g2d6g\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:36.967111 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:36.967079    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ec417d-1da2-4d03-ab16-5a8be736ec18-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:37.228449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.228351    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:37.228704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.228682    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 17:38:37.228758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.228736    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 17:38:37.457509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.457479    2559 generic.go:356] "Generic (PLEG): container finished" podID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerID="919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da" exitCode=0
Sep 09 17:38:37.457995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.457523    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"
Sep 09 17:38:37.457995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.457563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerDied","Data":"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"}
Sep 09 17:38:37.457995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.457622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5" event={"ID":"f3ec417d-1da2-4d03-ab16-5a8be736ec18","Type":"ContainerDied","Data":"07c4318aea123f8d6f78a49fcf4d7a99a33cf86fda265f221e2a8e98328d8654"}
Sep 09 17:38:37.457995 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.457646    2559 scope.go:117] "RemoveContainer" containerID="919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"
Sep 09 17:38:37.466389 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.466377    2559 scope.go:117] "RemoveContainer" containerID="5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"
Sep 09 17:38:37.474077 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.474056    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:38:37.474698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.474675    2559 scope.go:117] "RemoveContainer" containerID="919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"
Sep 09 17:38:37.474952 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:38:37.474935    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da\": container with ID starting with 919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da not found: ID does not exist" containerID="919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"
Sep 09 17:38:37.475036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.474979    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da"} err="failed to get container status \"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da\": rpc error: code = NotFound desc = could not find container \"919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da\": container with ID starting with 919bb010c0745ac337e898529807f0e905748d358c7a33f2e1447d9eb30891da not found: ID does not exist"
Sep 09 17:38:37.475036 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.474994    2559 scope.go:117] "RemoveContainer" containerID="5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"
Sep 09 17:38:37.475235 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:38:37.475220    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694\": container with ID starting with 5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694 not found: ID does not exist" containerID="5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"
Sep 09 17:38:37.475279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.475238    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694"} err="failed to get container status \"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694\": rpc error: code = NotFound desc = could not find container \"5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694\": container with ID starting with 5f02d5cde57dccce7ed0af5bb32352b02700728f6ca8dfef9883246830207694 not found: ID does not exist"
Sep 09 17:38:37.485620 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:37.485541    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-95cd01-openshift-default-6b95bbf864-jnzl5"]
Sep 09 17:38:38.229008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:38.228943    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 17:38:38.229187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:38.229030    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 17:38:39.052919 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:39.052883    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" path="/var/lib/kubelet/pods/f3ec417d-1da2-4d03-ab16-5a8be736ec18/volumes"
Sep 09 17:38:39.228856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:39.228821    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 17:38:39.229052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:39.228874    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 17:38:40.229436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:40.229382    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 17:38:40.229809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:40.229454    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 17:38:41.228743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:41.228705    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 17:38:41.228930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:41.228771    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 17:38:41.488756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:41.488640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:42.232344 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.232312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:42.232669 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.232649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:42.233236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.233217    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:38:42.444991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.444949    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:38:42.445195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.445173    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" podUID="9a0de804-d036-40c5-95b7-2946ca298576" containerName="maas-api" containerID="cri-o://84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e" gracePeriod=30
Sep 09 17:38:42.475199 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.475171    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:42.575316 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.575205    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:42.675695 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.675662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:42.734259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.734197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:42.904685 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:42.904659    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:38:43.029918 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.029888    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvftk\" (UniqueName: \"kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk\") pod \"9a0de804-d036-40c5-95b7-2946ca298576\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") "
Sep 09 17:38:43.030136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.029944    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca\") pod \"9a0de804-d036-40c5-95b7-2946ca298576\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") "
Sep 09 17:38:43.030136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.029995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs\") pod \"9a0de804-d036-40c5-95b7-2946ca298576\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") "
Sep 09 17:38:43.030136 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.030074    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") pod \"9a0de804-d036-40c5-95b7-2946ca298576\" (UID: \"9a0de804-d036-40c5-95b7-2946ca298576\") "
Sep 09 17:38:43.030446 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.030384    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a0de804-d036-40c5-95b7-2946ca298576" (UID: "9a0de804-d036-40c5-95b7-2946ca298576"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:38:43.030591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.030455    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0de804-d036-40c5-95b7-2946ca298576-openshift-service-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:43.032789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.032756    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a0de804-d036-40c5-95b7-2946ca298576" (UID: "9a0de804-d036-40c5-95b7-2946ca298576"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:38:43.032789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.032771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk" (OuterVolumeSpecName: "kube-api-access-dvftk") pod "9a0de804-d036-40c5-95b7-2946ca298576" (UID: "9a0de804-d036-40c5-95b7-2946ca298576"). InnerVolumeSpecName "kube-api-access-dvftk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:38:43.032914 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.032828    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a0de804-d036-40c5-95b7-2946ca298576" (UID: "9a0de804-d036-40c5-95b7-2946ca298576"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:38:43.131128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.131099    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvftk\" (UniqueName: \"kubernetes.io/projected/9a0de804-d036-40c5-95b7-2946ca298576-kube-api-access-dvftk\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:43.131128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.131120    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-metrics-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:43.131128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.131130    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a0de804-d036-40c5-95b7-2946ca298576-maas-api-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:43.178117 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.178089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:43.488613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.488536    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a0de804-d036-40c5-95b7-2946ca298576" containerID="84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e" exitCode=0
Sep 09 17:38:43.488613 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.488589    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"
Sep 09 17:38:43.488772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.488621    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" event={"ID":"9a0de804-d036-40c5-95b7-2946ca298576","Type":"ContainerDied","Data":"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"}
Sep 09 17:38:43.488772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.488670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj" event={"ID":"9a0de804-d036-40c5-95b7-2946ca298576","Type":"ContainerDied","Data":"07fdbad982ee4419e823883500d8207d30c9d4f756c7ac23e6a7ac45bb562a8d"}
Sep 09 17:38:43.488772 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.488691    2559 scope.go:117] "RemoveContainer" containerID="84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"
Sep 09 17:38:43.497404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.497387    2559 scope.go:117] "RemoveContainer" containerID="84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"
Sep 09 17:38:43.497688 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:38:43.497669    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e\": container with ID starting with 84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e not found: ID does not exist" containerID="84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"
Sep 09 17:38:43.497797 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.497696    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e"} err="failed to get container status \"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e\": rpc error: code = NotFound desc = could not find container \"84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e\": container with ID starting with 84a337a53448d2d68df356bb9dbbd021b7f7fbc90563d76435b16f7993a5626e not found: ID does not exist"
Sep 09 17:38:43.506253 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.506231    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:38:43.509648 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:43.509627    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea996c-6ddf665989-5nwcj"]
Sep 09 17:38:44.187915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:44.187882    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:44.834469 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:44.834422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:44.930465 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:44.930424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:45.052510 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:45.052476    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0de804-d036-40c5-95b7-2946ca298576" path="/var/lib/kubelet/pods/9a0de804-d036-40c5-95b7-2946ca298576/volumes"
Sep 09 17:38:45.262921 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:45.262880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:48.841256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:48.841226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:49.003750 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:49.003710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:49.079976 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:49.079924    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:38:49.080190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:49.080143    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy" containerID="cri-o://30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88" gracePeriod=30
Sep 09 17:38:49.168490 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:49.168448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:49.569442 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:49.569361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:51.020138 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:51.020102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:51.121275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:51.121245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:51.478676 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:51.478644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:54.327936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.327910    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:38:54.433610 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433575    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433761 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433761 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433761 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qrq\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.433905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433890    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:54.434150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.433903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.434150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434006    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket\") pod \"bba1b036-d379-4d60-86df-c7df6ee93051\" (UID: \"bba1b036-d379-4d60-86df-c7df6ee93051\") "
Sep 09 17:38:54.434150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434074    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:54.434150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data" (OuterVolumeSpecName: "istio-data") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:54.434331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:38:54.434519 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:54.434557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434515    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.434557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434534    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.434557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434547    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.434658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.434561    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bba1b036-d379-4d60-86df-c7df6ee93051-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.436039 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.436016    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:38:54.436143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.436041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token" (OuterVolumeSpecName: "istio-token") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:38:54.436143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.436062    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq" (OuterVolumeSpecName: "kube-api-access-42qrq") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "kube-api-access-42qrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:38:54.436420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.436397    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bba1b036-d379-4d60-86df-c7df6ee93051" (UID: "bba1b036-d379-4d60-86df-c7df6ee93051"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:38:54.535257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.535234    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qrq\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-kube-api-access-42qrq\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.535257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.535257    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.535418 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.535266    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bba1b036-d379-4d60-86df-c7df6ee93051-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.535418 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.535274    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba1b036-d379-4d60-86df-c7df6ee93051-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.535418 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.535283    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bba1b036-d379-4d60-86df-c7df6ee93051-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:38:54.542900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.542870    2559 generic.go:356] "Generic (PLEG): container finished" podID="bba1b036-d379-4d60-86df-c7df6ee93051" containerID="30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88" exitCode=0
Sep 09 17:38:54.543040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.542924    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"
Sep 09 17:38:54.543040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.542976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerDied","Data":"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"}
Sep 09 17:38:54.543122 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.543047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v" event={"ID":"bba1b036-d379-4d60-86df-c7df6ee93051","Type":"ContainerDied","Data":"dd208f65c1ab4a4b3accc3f14f2bdf44c868eb36ec97010e24d86c9ccfbe695f"}
Sep 09 17:38:54.543122 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.543078    2559 scope.go:117] "RemoveContainer" containerID="30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"
Sep 09 17:38:54.552648 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.552631    2559 scope.go:117] "RemoveContainer" containerID="417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"
Sep 09 17:38:54.560423 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.560403    2559 scope.go:117] "RemoveContainer" containerID="30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"
Sep 09 17:38:54.560719 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:38:54.560694    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88\": container with ID starting with 30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88 not found: ID does not exist" containerID="30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"
Sep 09 17:38:54.560813 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.560727    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88"} err="failed to get container status \"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88\": rpc error: code = NotFound desc = could not find container \"30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88\": container with ID starting with 30f940a37b0cc97108249cc42627a62ffec15bcb63626c78cb036ad3b2dddb88 not found: ID does not exist"
Sep 09 17:38:54.560813 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.560750    2559 scope.go:117] "RemoveContainer" containerID="417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"
Sep 09 17:38:54.561087 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:38:54.561052    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8\": container with ID starting with 417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8 not found: ID does not exist" containerID="417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"
Sep 09 17:38:54.561179 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.561092    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8"} err="failed to get container status \"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8\": rpc error: code = NotFound desc = could not find container \"417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8\": container with ID starting with 417f3682c94b68677baa0ff8edd686d7f37146a704a48b2b908976419b3d1ab8 not found: ID does not exist"
Sep 09 17:38:54.564255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.564234    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:38:54.567868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:54.567847    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ea996c-openshift-default-65566cfdf6-5zh9v"]
Sep 09 17:38:55.052181 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:55.052151    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" path="/var/lib/kubelet/pods/bba1b036-d379-4d60-86df-c7df6ee93051/volumes"
Sep 09 17:38:57.099788 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:57.099759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:38:59.575719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:38:59.575688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:00.067773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.067737    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:39:00.068098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.068072    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" podUID="684e1f25-b868-4879-b090-063f9eaacc85" containerName="maas-api" containerID="cri-o://6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c" gracePeriod=30
Sep 09 17:39:00.094551 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.094511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:00.196169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.196139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:00.281337 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.281299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:00.318280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.318227    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:39:00.346776 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.346739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:00.385826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.385798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4wk\" (UniqueName: \"kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk\") pod \"684e1f25-b868-4879-b090-063f9eaacc85\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") "
Sep 09 17:39:00.385947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.385887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca\") pod \"684e1f25-b868-4879-b090-063f9eaacc85\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") "
Sep 09 17:39:00.385947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.385930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs\") pod \"684e1f25-b868-4879-b090-063f9eaacc85\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") "
Sep 09 17:39:00.386053 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.385948    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") pod \"684e1f25-b868-4879-b090-063f9eaacc85\" (UID: \"684e1f25-b868-4879-b090-063f9eaacc85\") "
Sep 09 17:39:00.386348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.386316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "684e1f25-b868-4879-b090-063f9eaacc85" (UID: "684e1f25-b868-4879-b090-063f9eaacc85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:39:00.388001 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.387956    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk" (OuterVolumeSpecName: "kube-api-access-dj4wk") pod "684e1f25-b868-4879-b090-063f9eaacc85" (UID: "684e1f25-b868-4879-b090-063f9eaacc85"). InnerVolumeSpecName "kube-api-access-dj4wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:39:00.388117 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.388097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "684e1f25-b868-4879-b090-063f9eaacc85" (UID: "684e1f25-b868-4879-b090-063f9eaacc85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:39:00.388251 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.388237    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "684e1f25-b868-4879-b090-063f9eaacc85" (UID: "684e1f25-b868-4879-b090-063f9eaacc85"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:39:00.487449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.487410    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/684e1f25-b868-4879-b090-063f9eaacc85-openshift-service-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:00.487449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.487441    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-metrics-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:00.487449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.487451    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/684e1f25-b868-4879-b090-063f9eaacc85-maas-api-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:00.487449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.487459    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4wk\" (UniqueName: \"kubernetes.io/projected/684e1f25-b868-4879-b090-063f9eaacc85-kube-api-access-dj4wk\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:00.572881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.572806    2559 generic.go:356] "Generic (PLEG): container finished" podID="684e1f25-b868-4879-b090-063f9eaacc85" containerID="6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c" exitCode=0
Sep 09 17:39:00.572881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.572842    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"
Sep 09 17:39:00.573080 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.572883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" event={"ID":"684e1f25-b868-4879-b090-063f9eaacc85","Type":"ContainerDied","Data":"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"}
Sep 09 17:39:00.573080 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.572934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx" event={"ID":"684e1f25-b868-4879-b090-063f9eaacc85","Type":"ContainerDied","Data":"c204dd6e8768a700152d17a842ce09ed21e11215e1f270cd64be22bea0211d16"}
Sep 09 17:39:00.573080 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.572977    2559 scope.go:117] "RemoveContainer" containerID="6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"
Sep 09 17:39:00.581820 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.581804    2559 scope.go:117] "RemoveContainer" containerID="6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"
Sep 09 17:39:00.582130 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:39:00.582099    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c\": container with ID starting with 6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c not found: ID does not exist" containerID="6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"
Sep 09 17:39:00.582130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.582122    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c"} err="failed to get container status \"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c\": rpc error: code = NotFound desc = could not find container \"6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c\": container with ID starting with 6f85af2c1ec17a34d92dd625a8efc0f4bf01e7fbf442a78f9692d8c855d5ba8c not found: ID does not exist"
Sep 09 17:39:00.593117 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.593085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:39:00.594697 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.594678    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-53da12-78dc979d9-bp5dx"]
Sep 09 17:39:00.643176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:00.643149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:01.052605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:01.052563    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684e1f25-b868-4879-b090-063f9eaacc85" path="/var/lib/kubelet/pods/684e1f25-b868-4879-b090-063f9eaacc85/volumes"
Sep 09 17:39:01.562413 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:01.562376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:02.229006 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:02.228949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:02.332276 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:02.332246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:02.415519 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:02.415486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:02.483190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:02.483113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:02.872078 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:02.871990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:06.084089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:06.084055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:06.640144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:06.640106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:06.699462 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:06.699419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:06.750099 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:06.750070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:06.809556 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:06.809526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:07.018539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.018508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:07.554984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.554924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:07.845652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.845571    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:39:07.845994 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.845974    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:07.845994 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.845991    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846005    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846012    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846025    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846033    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846050    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0de804-d036-40c5-95b7-2946ca298576" containerName="maas-api"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846058    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0de804-d036-40c5-95b7-2946ca298576" containerName="maas-api"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846087    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684e1f25-b868-4879-b090-063f9eaacc85" containerName="maas-api"
Sep 09 17:39:07.846140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846093    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="684e1f25-b868-4879-b090-063f9eaacc85" containerName="maas-api"
Sep 09 17:39:07.846404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846154    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:07.846404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846163    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="684e1f25-b868-4879-b090-063f9eaacc85" containerName="maas-api"
Sep 09 17:39:07.846404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846169    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846180    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ec417d-1da2-4d03-ab16-5a8be736ec18" containerName="istio-proxy"
Sep 09 17:39:07.846404 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.846190    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0de804-d036-40c5-95b7-2946ca298576" containerName="maas-api"
Sep 09 17:39:07.848115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.848100    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.850521 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.850501    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-480517-openshift-default-dockercfg-smzld\""
Sep 09 17:39:07.859722 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.859700    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:39:07.869368 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.869344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:07.955926 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.955890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956174 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956146    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956289 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956344 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26w8\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956405 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956458 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956531 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956672 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:07.956758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:07.956729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.057645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.057823 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.057823 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.057823 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26w8\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.057823 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058079 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058079 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058079 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.057919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058079 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058281 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058281 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058281 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058428 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.058557 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.058536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.060401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.060379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.060686 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.060665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.065243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.065216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.065340 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.065311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26w8\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8\") pod \"e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") " pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.158795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.158720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:08.385147 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.385115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:08.432895 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.432871    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:39:08.434668 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:39:08.434644    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode008bb9d_8a63_4cae_94c6_1d46a19180ea.slice/crio-d8dfff410d548719141ca058a5a717ebaf38daa4da753933c27c2531dda3fe4a WatchSource:0}: Error finding container d8dfff410d548719141ca058a5a717ebaf38daa4da753933c27c2531dda3fe4a: Status 404 returned error can't find the container with id d8dfff410d548719141ca058a5a717ebaf38daa4da753933c27c2531dda3fe4a
Sep 09 17:39:08.436756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.436723    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:08.436814 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.436793    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:08.436847 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.436822    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:08.621010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.620915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerStarted","Data":"3bcb188176570b7c61f3be65267c6abd7f915e981d11e35a3e7d3e12a5408077"}
Sep 09 17:39:08.621010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.620997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerStarted","Data":"d8dfff410d548719141ca058a5a717ebaf38daa4da753933c27c2531dda3fe4a"}
Sep 09 17:39:08.639880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.639820    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podStartSLOduration=1.639800126 podStartE2EDuration="1.639800126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:39:08.639102405 +0000 UTC m=+1320.056699603" watchObservedRunningTime="2026-09-09 17:39:08.639800126 +0000 UTC m=+1320.057397273"
Sep 09 17:39:08.656920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.656889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:08.715299 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.715217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:08.883142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.883109    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:39:08.883417 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.883367    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" containerID="cri-o://45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084" gracePeriod=30
Sep 09 17:39:08.897168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:08.897140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:09.158883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.158814    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:09.160449 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.160422    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:09.160588 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.160481    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:09.348318 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.348287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:09.861325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.861297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:09.928812 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:09.928776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:10.163229 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:10.163151    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:10.621714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:10.621683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:10.630169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:10.630145    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:10.631284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:10.631256    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:10.721759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:10.721729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:11.599401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:11.599357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:11.781483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:11.781449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:11.882279 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:11.882196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:12.234495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:12.234464    2559 patch_prober.go:28] interesting pod/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 17:39:12.234634 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:12.234518    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:39:12.248275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:12.248247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:12.344789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:12.344758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:12.422244 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:12.422215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:14.144482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.144430    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:39:14.215303 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215273    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5std\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215379    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215421    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215441    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215561    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215598    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215678 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215657    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215684    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo\") pod \"79399d43-ec05-4bd9-918c-62db3567c020\" (UID: \"79399d43-ec05-4bd9-918c-62db3567c020\") "
Sep 09 17:39:14.215842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:39:14.215842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215718    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:39:14.215842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:39:14.215842 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215796    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.215934    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data" (OuterVolumeSpecName: "istio-data") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.216075    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79399d43-ec05-4bd9-918c-62db3567c020-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.216104    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.216119    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.216132    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.216367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.216145    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.217705 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.217677    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:39:14.217797 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.217720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std" (OuterVolumeSpecName: "kube-api-access-j5std") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "kube-api-access-j5std". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:39:14.217840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.217819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token" (OuterVolumeSpecName: "istio-token") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:39:14.217905 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.217887    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79399d43-ec05-4bd9-918c-62db3567c020" (UID: "79399d43-ec05-4bd9-918c-62db3567c020"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:39:14.317255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.317232    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79399d43-ec05-4bd9-918c-62db3567c020-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.317255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.317254    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.317420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.317263    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79399d43-ec05-4bd9-918c-62db3567c020-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.317420 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.317275    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5std\" (UniqueName: \"kubernetes.io/projected/79399d43-ec05-4bd9-918c-62db3567c020-kube-api-access-j5std\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:39:14.649017 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.648980    2559 generic.go:356] "Generic (PLEG): container finished" podID="79399d43-ec05-4bd9-918c-62db3567c020" containerID="45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084" exitCode=0
Sep 09 17:39:14.649190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.649039    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"
Sep 09 17:39:14.649190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.649052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerDied","Data":"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"}
Sep 09 17:39:14.649190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.649120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl" event={"ID":"79399d43-ec05-4bd9-918c-62db3567c020","Type":"ContainerDied","Data":"a2fac89325025e1cbcfa70169d8eb5cf607fa61f0b9a9be4f3a6e0b7558d9246"}
Sep 09 17:39:14.649190 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.649151    2559 scope.go:117] "RemoveContainer" containerID="45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"
Sep 09 17:39:14.660386 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.660274    2559 scope.go:117] "RemoveContainer" containerID="375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"
Sep 09 17:39:14.670046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.670030    2559 scope.go:117] "RemoveContainer" containerID="45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"
Sep 09 17:39:14.670321 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:39:14.670302    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084\": container with ID starting with 45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084 not found: ID does not exist" containerID="45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"
Sep 09 17:39:14.670401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.670333    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084"} err="failed to get container status \"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084\": rpc error: code = NotFound desc = could not find container \"45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084\": container with ID starting with 45d5692dea70239b14fbf521c94140a6930ff52d8cf61529b9b010f08336f084 not found: ID does not exist"
Sep 09 17:39:14.670401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.670351    2559 scope.go:117] "RemoveContainer" containerID="375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"
Sep 09 17:39:14.670619 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:39:14.670601    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc\": container with ID starting with 375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc not found: ID does not exist" containerID="375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"
Sep 09 17:39:14.670666 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.670625    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc"} err="failed to get container status \"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc\": rpc error: code = NotFound desc = could not find container \"375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc\": container with ID starting with 375761e40e97de37fbadc79c36a84011ca1caad5058974201cab00488d7db1dc not found: ID does not exist"
Sep 09 17:39:14.671471 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.671455    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:39:14.677361 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:14.677338    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-71f58f92-openshift-default-5c7d9d7676-thmcl"]
Sep 09 17:39:15.051017 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:15.050985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:15.052162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:15.052140    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79399d43-ec05-4bd9-918c-62db3567c020" path="/var/lib/kubelet/pods/79399d43-ec05-4bd9-918c-62db3567c020/volumes"
Sep 09 17:39:15.159691 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:15.159656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:15.251329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:15.251294    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:15.378898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:15.378812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:21.098673 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:21.098632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:21.201999 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:21.201896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:21.913589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:21.913550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:22.201007 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.200976    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:39:22.201460 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201444    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:22.201532 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201461    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:22.201532 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201488    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:22.201532 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201496    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:22.201701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201578    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:22.201701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201590    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba1b036-d379-4d60-86df-c7df6ee93051" containerName="istio-proxy"
Sep 09 17:39:22.201701 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.201606    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:22.206292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.206261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.208936 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.208911    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-6b44e3-openshift-default-dockercfg-7cf8v\""
Sep 09 17:39:22.214429 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.214406    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:39:22.229527 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.229504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:22.296225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbmcj\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296523 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296563 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296563 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.296645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.296623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbmcj\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.397924 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.397911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.398343 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.398018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.398408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.398379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.398675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.398646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.398771 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.398756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.398828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.398647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.399019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.399000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.400355 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.400327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.400862 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.400842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.405376 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.405341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbmcj\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.405689 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.405670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token\") pod \"e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") " pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.425973 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.425936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:22.521222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.521153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:22.805649 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.805621    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:39:22.807721 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:39:22.807690    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceaa8a3_035f_4bbf_a1ba_7c94795be4e3.slice/crio-4477999f9ed7ccff9a549f38007d22502dd8e00aa95c50dfb268fff08e9c96ac WatchSource:0}: Error finding container 4477999f9ed7ccff9a549f38007d22502dd8e00aa95c50dfb268fff08e9c96ac: Status 404 returned error can't find the container with id 4477999f9ed7ccff9a549f38007d22502dd8e00aa95c50dfb268fff08e9c96ac
Sep 09 17:39:22.810098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.810060    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:22.810194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.810147    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:22.810256 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:22.810192    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:23.695134 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:23.695098    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerStarted","Data":"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"}
Sep 09 17:39:23.695512 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:23.695156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerStarted","Data":"4477999f9ed7ccff9a549f38007d22502dd8e00aa95c50dfb268fff08e9c96ac"}
Sep 09 17:39:23.715601 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:23.715555    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podStartSLOduration=1.715541613 podStartE2EDuration="1.715541613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:39:23.715361246 +0000 UTC m=+1335.132958417" watchObservedRunningTime="2026-09-09 17:39:23.715541613 +0000 UTC m=+1335.133138762"
Sep 09 17:39:24.522197 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:24.522155    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:24.526934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:24.526903    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:24.699979 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:24.699938    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:24.701016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:24.700992    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:25.605338 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.605302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:25.631194 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.631159    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:25.631335 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.631216    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:25.706561 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.706524    2559 generic.go:356] "Generic (PLEG): container finished" podID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerID="3bcb188176570b7c61f3be65267c6abd7f915e981d11e35a3e7d3e12a5408077" exitCode=0
Sep 09 17:39:25.707026 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.706589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerDied","Data":"3bcb188176570b7c61f3be65267c6abd7f915e981d11e35a3e7d3e12a5408077"}
Sep 09 17:39:25.707168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.707151    2559 scope.go:117] "RemoveContainer" containerID="3bcb188176570b7c61f3be65267c6abd7f915e981d11e35a3e7d3e12a5408077"
Sep 09 17:39:25.708101 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.708076    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:25.708161 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.708143    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:25.708201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.708173    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:25.911024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:25.910918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:26.713494 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:26.713456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerStarted","Data":"a0655fce6c0404385f9914d94dc34738c87a7105fed1480700245e63fc1c68d9"}
Sep 09 17:39:26.910869 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:26.910839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:27.011350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.011240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:27.158998 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.158943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:27.159346 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.159314    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:27.159477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.159377    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:27.319097 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.318998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:27.456990 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.454601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:27.554046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:27.553988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:28.160029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:28.159995    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:28.160418 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:28.160046    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:29.159159 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:29.159120    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:29.159325 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:29.159188    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:30.159347 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:30.159271    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:30.159347 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:30.159328    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:31.160265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:31.160222    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 17:39:31.160762 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:31.160315    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 17:39:32.163903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:32.163874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:32.164317 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:32.164146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:32.164880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:32.164861    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:39:32.807675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:32.807633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:35.455066 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:35.455019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:35.770677 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:35.770583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:36.040805 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.040717    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:39:36.041455 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.041428    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:36.041455 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.041455    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79399d43-ec05-4bd9-918c-62db3567c020" containerName="istio-proxy"
Sep 09 17:39:36.045040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.045017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.047409 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.047387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-17e67b-openshift-default-dockercfg-kvwww\""
Sep 09 17:39:36.057076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.057052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:39:36.074412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.074386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:36.136665 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136665 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2969j\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.136927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.137213 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.136943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.137213 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.137004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.237941 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.237903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2969j\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.237952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.237995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238171 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238552 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238615 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.238872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.238851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.239050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.239032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.239128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.239098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.239128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.239114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.240528 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.240510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.240640 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.240621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.245950 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.245928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2969j\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.246315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.246297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token\") pod \"e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") " pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.356687 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.356596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:36.519811 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.519778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:36.652143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.652118    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:39:36.654435 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:39:36.654407    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f831f33_a6ca_4bc0_afc9_1928aa52db6e.slice/crio-bba474e4aded7f522163ea5ae46bb0ace9ae7578b56a3c5c209062d3ba2479fc WatchSource:0}: Error finding container bba474e4aded7f522163ea5ae46bb0ace9ae7578b56a3c5c209062d3ba2479fc: Status 404 returned error can't find the container with id bba474e4aded7f522163ea5ae46bb0ace9ae7578b56a3c5c209062d3ba2479fc
Sep 09 17:39:36.656882 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.656841    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:36.656951 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.656933    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:36.657024 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.657001    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:36.767581 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.767547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerStarted","Data":"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"}
Sep 09 17:39:36.767700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.767609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerStarted","Data":"bba474e4aded7f522163ea5ae46bb0ace9ae7578b56a3c5c209062d3ba2479fc"}
Sep 09 17:39:36.786408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:36.786351    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podStartSLOduration=0.78633152 podStartE2EDuration="786.33152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:39:36.784253105 +0000 UTC m=+1348.201850256" watchObservedRunningTime="2026-09-09 17:39:36.78633152 +0000 UTC m=+1348.203928673"
Sep 09 17:39:37.356783 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:37.356751    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:37.358392 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:37.358357    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:37.358502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:37.358421    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:38.361856 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:38.361827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:38.776587 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:38.776550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:38.777535 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:38.777513    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:38.834313 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:38.834273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:38.911988 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:38.911942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:39.808807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:39.808774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:39.908724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:39.908681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:40.009125 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.009090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:40.177683 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.177648    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:35964->10.134.0.43:15021: read: connection reset by peer" start-of-body=
Sep 09 17:39:40.177868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.177723    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:35964->10.134.0.43:15021: read: connection reset by peer"
Sep 09 17:39:40.286445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.286407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:40.368616 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.368518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:40.788714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.788676    2559 generic.go:356] "Generic (PLEG): container finished" podID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerID="69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6" exitCode=0
Sep 09 17:39:40.788882 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.788749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerDied","Data":"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"}
Sep 09 17:39:40.789259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.789241    2559 scope.go:117] "RemoveContainer" containerID="69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"
Sep 09 17:39:40.790254 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.790225    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:40.790367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.790304    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:40.790367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:40.790356    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:41.799569 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:41.799507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerStarted","Data":"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"}
Sep 09 17:39:42.521745 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:42.521708    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:42.521993 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:42.521942    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 17:39:42.522064 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:42.522023    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 17:39:43.521758 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:43.521720    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 17:39:43.522176 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:43.521780    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 17:39:44.521885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:44.521851    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 17:39:44.522292 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:44.521929    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 17:39:45.522180 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:45.522133    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 17:39:45.522693 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:45.522204    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 17:39:46.522150 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:46.522110    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 17:39:46.522495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:46.522461    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 17:39:47.525258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:47.525223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:47.525706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:47.525633    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:47.526300 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:47.526281    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:39:47.810906 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:47.810822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:48.663885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:48.663855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:50.550354 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:50.550316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:50.863246 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:50.863154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:51.142647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.142529    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:39:51.145787 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.145758    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.148406 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.148380    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-607751-openshift-default-dockercfg-xbqlr\""
Sep 09 17:39:51.157711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.157683    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:39:51.188166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.188135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:51.196120 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196260 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196260 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj47m\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196260 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196391 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196391 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196514 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196559 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.196559 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.196552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297272 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297488 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj47m\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297488 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297488 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297488 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.297759 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.298010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.298010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.297937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.298204 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.298182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.298295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.298276    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.298349 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.298330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.300117 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.300090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.300437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.300415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.306294 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.306267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj47m\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.306466 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.306444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token\") pod \"e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") " pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.335188 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.335157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:51.460062 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.460025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:51.737339 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.737251    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:39:51.741306 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:39:51.741263    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d4c4fe_babf_4e46_821d_38ee8fa71ee2.slice/crio-ca06b29945e0f98ca0423feb5d65c8ec313b2e391b257fdfb5efb9e6b627dce1 WatchSource:0}: Error finding container ca06b29945e0f98ca0423feb5d65c8ec313b2e391b257fdfb5efb9e6b627dce1: Status 404 returned error can't find the container with id ca06b29945e0f98ca0423feb5d65c8ec313b2e391b257fdfb5efb9e6b627dce1
Sep 09 17:39:51.743890 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.743846    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:51.744057 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.743922    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:51.744057 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.743994    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:51.868675 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.868631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerStarted","Data":"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"}
Sep 09 17:39:51.868907 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.868707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerStarted","Data":"ca06b29945e0f98ca0423feb5d65c8ec313b2e391b257fdfb5efb9e6b627dce1"}
Sep 09 17:39:51.888826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:51.888772    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podStartSLOduration=0.888755319 podStartE2EDuration="888.755319ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:39:51.888042787 +0000 UTC m=+1363.305639938" watchObservedRunningTime="2026-09-09 17:39:51.888755319 +0000 UTC m=+1363.306352469"
Sep 09 17:39:52.461236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:52.461199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:52.466365 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:52.466340    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:52.874281 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:52.874192    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:52.875296 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:52.875277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:39:53.778605 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.778568    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:53.778774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.778638    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:53.799241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.799214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:53.881439 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.881364    2559 generic.go:356] "Generic (PLEG): container finished" podID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerID="ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d" exitCode=0
Sep 09 17:39:53.881819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.881436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerDied","Data":"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"}
Sep 09 17:39:53.881954 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.881938    2559 scope.go:117] "RemoveContainer" containerID="ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"
Sep 09 17:39:53.883052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.883025    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:53.883123 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.883090    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:53.883167 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:53.883124    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:39:54.145034 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:54.144997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:54.891892 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:54.891845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerStarted","Data":"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"}
Sep 09 17:39:55.072753 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.072724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:55.177350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.177312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:55.357533 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.357498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:39:55.357748 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.357727    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:55.357805 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.357787    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:55.512196 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.512106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:55.614096 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:55.614061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:39:56.356944 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:56.356899    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:56.357378 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:56.356993    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:57.357704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:57.357664    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:57.358161 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:57.357732    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:58.357250 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:58.357211    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:58.357441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:58.357271    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:39:59.357644 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:59.357611    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 17:39:59.358088 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:39:59.357660    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 17:40:00.361385 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:00.361354    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:40:00.361890 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:00.361758    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:40:00.362372 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:00.362352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:40:00.778327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:00.778290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:03.634639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:03.634598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:05.074412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:05.074378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:11.984016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.983955    2559 generic.go:356] "Generic (PLEG): container finished" podID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerID="55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97" exitCode=0
Sep 09 17:40:11.984392 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.984032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerDied","Data":"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"}
Sep 09 17:40:11.984436 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.984426    2559 scope.go:117] "RemoveContainer" containerID="55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"
Sep 09 17:40:11.985589 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.985552    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:11.985681 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.985660    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:11.985735 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:11.985719    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:12.994051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:12.994002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerStarted","Data":"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"}
Sep 09 17:40:13.461242 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:13.461203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:40:13.461432 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:13.461384    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 17:40:13.461507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:13.461440    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 17:40:14.460299 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:14.460263    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 17:40:14.460702 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:14.460324    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 17:40:15.374288 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.374257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:15.433951 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.433910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:15.461295 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.461261    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 17:40:15.461685 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.461347    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 17:40:15.500885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.500844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:15.670591 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.670561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:15.726812 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.726724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:15.900708 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:15.900584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:16.004022 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:16.003893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:16.461259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:16.461222    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 17:40:16.461429 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:16.461280    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 17:40:17.461318 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:17.461281    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 17:40:17.461502 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:17.461347    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 17:40:18.464978 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:18.464932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:40:18.465408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:18.465326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:40:18.465983 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:18.465938    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:40:18.789718 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:18.789634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:21.592862 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:21.592832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:21.707327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:21.707291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:21.844874 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:21.844798    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:40:21.845103 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:21.845074    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy" containerID="cri-o://a0655fce6c0404385f9914d94dc34738c87a7105fed1480700245e63fc1c68d9" gracePeriod=30
Sep 09 17:40:21.869861 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:21.869807    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:22.350104 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:22.350071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:27.072253 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.072221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerDied","Data":"a0655fce6c0404385f9914d94dc34738c87a7105fed1480700245e63fc1c68d9"}
Sep 09 17:40:27.072253 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.072244    2559 generic.go:356] "Generic (PLEG): container finished" podID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerID="a0655fce6c0404385f9914d94dc34738c87a7105fed1480700245e63fc1c68d9" exitCode=0
Sep 09 17:40:27.072727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.072290    2559 scope.go:117] "RemoveContainer" containerID="3bcb188176570b7c61f3be65267c6abd7f915e981d11e35a3e7d3e12a5408077"
Sep 09 17:40:27.094023 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.094002    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:40:27.140880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.140880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140837    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.140880 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140870    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140950    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.140994    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v26w8\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141045    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141107    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert\") pod \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\" (UID: \"e008bb9d-8a63-4cae-94c6-1d46a19180ea\") "
Sep 09 17:40:27.141483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:27.141483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141246    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:27.141483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141266    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:27.141483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141474    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:27.141698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141551    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.141698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141570    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.141698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141585    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.141698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141598    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.141868 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.141726    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:40:27.143804 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.143779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:40:27.143804 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.143795    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8" (OuterVolumeSpecName: "kube-api-access-v26w8") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "kube-api-access-v26w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:40:27.143953 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.143871    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:40:27.144215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.144195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e008bb9d-8a63-4cae-94c6-1d46a19180ea" (UID: "e008bb9d-8a63-4cae-94c6-1d46a19180ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:27.242808 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.242777    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.242808 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.242810    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.243038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.242825    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v26w8\" (UniqueName: \"kubernetes.io/projected/e008bb9d-8a63-4cae-94c6-1d46a19180ea-kube-api-access-v26w8\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.243038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.242841    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:27.243038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:27.242856    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e008bb9d-8a63-4cae-94c6-1d46a19180ea-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:28.078774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:28.078749    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"
Sep 09 17:40:28.079217 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:28.078745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8" event={"ID":"e008bb9d-8a63-4cae-94c6-1d46a19180ea","Type":"ContainerDied","Data":"d8dfff410d548719141ca058a5a717ebaf38daa4da753933c27c2531dda3fe4a"}
Sep 09 17:40:28.079217 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:28.078896    2559 scope.go:117] "RemoveContainer" containerID="a0655fce6c0404385f9914d94dc34738c87a7105fed1480700245e63fc1c68d9"
Sep 09 17:40:28.115401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:28.109155    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:40:28.118199 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:28.118173    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-480517-openshift-default-5cb495d67d-xs4g8"]
Sep 09 17:40:29.051952 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:29.051918    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" path="/var/lib/kubelet/pods/e008bb9d-8a63-4cae-94c6-1d46a19180ea/volumes"
Sep 09 17:40:32.142407 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.142370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:32.422423 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.422390    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:40:32.422956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.422937    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:40:32.423068 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.422991    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:40:32.423127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.423114    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:40:32.426636 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.426614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.429209 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.429188    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f636a1c6-openshift-default-dockercfg-hv2bw\""
Sep 09 17:40:32.436693 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.436631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:40:32.445469 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.445444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:32.487877 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.487847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.487879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.487906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8lr\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488211 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.488406 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.488222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.588917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.588883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.588917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.588923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.588952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.588997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589020    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8lr\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589208 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589577 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589577 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.589937 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.589922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.591917 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.591890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.592137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.592116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.596807 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.596776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8lr\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.596940 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.596923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token\") pod \"e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") " pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.676661 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.676576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:32.741558 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.741275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:32.755228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.754608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:32.850168 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.850139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:32.954756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:32.954672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:33.024715 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.024694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:40:33.026600 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:40:33.026570    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb06f19_2d89_470a_a913_68f7493487e2.slice/crio-af0f994e2512e345cd398a328fde14c5718fc52b674ce16c06c6a2f9513b5ef7 WatchSource:0}: Error finding container af0f994e2512e345cd398a328fde14c5718fc52b674ce16c06c6a2f9513b5ef7: Status 404 returned error can't find the container with id af0f994e2512e345cd398a328fde14c5718fc52b674ce16c06c6a2f9513b5ef7
Sep 09 17:40:33.027623 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.027586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:33.029127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.029097    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:33.029209 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.029158    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:33.029209 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.029189    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:33.107790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.107572    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerStarted","Data":"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"}
Sep 09 17:40:33.107790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.107649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerStarted","Data":"af0f994e2512e345cd398a328fde14c5718fc52b674ce16c06c6a2f9513b5ef7"}
Sep 09 17:40:33.140535 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.140466    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podStartSLOduration=1.140450153 podStartE2EDuration="1.140450153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:33.138191394 +0000 UTC m=+1404.555788534" watchObservedRunningTime="2026-09-09 17:40:33.140450153 +0000 UTC m=+1404.558047374"
Sep 09 17:40:33.443212 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.443167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:33.742428 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:33.742352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:34.747287 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:34.747257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:34.997277 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:34.997242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:35.094207 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:35.094102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:35.120840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:35.120808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:35.121860 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:35.121843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:36.159548 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:36.159502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:36.260259 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:36.260229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:36.361072 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:36.361039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:36.904616 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:36.904575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:38.112261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:38.112226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:39.355843 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:39.355808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:39.503294 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:39.503253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:39.581327 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:39.581290    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:40:39.581595 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:39.581571    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy" containerID="cri-o://92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c" gracePeriod=30
Sep 09 17:40:39.602521 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:39.602485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:40:44.860876 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.860814    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:40:44.913563 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913585    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913716    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.913763 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.914166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.913831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2969j\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j\") pod \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\" (UID: \"7f831f33-a6ca-4bc0-afc9-1928aa52db6e\") "
Sep 09 17:40:44.914166 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:44.914273 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914175    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:44.914273 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914208    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:44.914273 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:44.914694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914609    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:44.914694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.914675    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:40:44.916005 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.915981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:40:44.916422 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.916374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:40:44.916789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.916743    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j" (OuterVolumeSpecName: "kube-api-access-2969j") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "kube-api-access-2969j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:40:44.916789 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:44.916747    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f831f33-a6ca-4bc0-afc9-1928aa52db6e" (UID: "7f831f33-a6ca-4bc0-afc9-1928aa52db6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:40:45.015467 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015433    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015467 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015461    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015467 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015470    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2969j\" (UniqueName: \"kubernetes.io/projected/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-kube-api-access-2969j\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015481    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015490    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015497    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015504    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.015690 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.015512    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f831f33-a6ca-4bc0-afc9-1928aa52db6e-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:40:45.171725 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.171687    2559 generic.go:356] "Generic (PLEG): container finished" podID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerID="92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c" exitCode=0
Sep 09 17:40:45.171884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.171732    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"
Sep 09 17:40:45.171884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.171774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerDied","Data":"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"}
Sep 09 17:40:45.171884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.171833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns" event={"ID":"7f831f33-a6ca-4bc0-afc9-1928aa52db6e","Type":"ContainerDied","Data":"bba474e4aded7f522163ea5ae46bb0ace9ae7578b56a3c5c209062d3ba2479fc"}
Sep 09 17:40:45.171884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.171858    2559 scope.go:117] "RemoveContainer" containerID="92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"
Sep 09 17:40:45.180662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.180647    2559 scope.go:117] "RemoveContainer" containerID="ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"
Sep 09 17:40:45.188809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.188779    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:40:45.194002 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.193950    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-17e67b-openshift-default-894bffb6b-zh8ns"]
Sep 09 17:40:45.203747 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.203718    2559 scope.go:117] "RemoveContainer" containerID="92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"
Sep 09 17:40:45.204471 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:40:45.204266    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c\": container with ID starting with 92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c not found: ID does not exist" containerID="92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"
Sep 09 17:40:45.204471 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.204307    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c"} err="failed to get container status \"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c\": rpc error: code = NotFound desc = could not find container \"92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c\": container with ID starting with 92e9d1d7e1e0dc809b31342c5c66d4c7ebf59f6dc0fb706d8e82341d4d7a286c not found: ID does not exist"
Sep 09 17:40:45.204471 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.204330    2559 scope.go:117] "RemoveContainer" containerID="ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"
Sep 09 17:40:45.205124 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:40:45.205036    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d\": container with ID starting with ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d not found: ID does not exist" containerID="ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"
Sep 09 17:40:45.205124 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:45.205071    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d"} err="failed to get container status \"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d\": rpc error: code = NotFound desc = could not find container \"ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d\": container with ID starting with ae6f71a85dc2afcbccd7cafd7dbafc6754ce08b1230efea1af1ba47794c5294d not found: ID does not exist"
Sep 09 17:40:47.053740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:47.053702    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" path="/var/lib/kubelet/pods/7f831f33-a6ca-4bc0-afc9-1928aa52db6e/volumes"
Sep 09 17:40:51.163139 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:51.163097    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 17:40:51.163645 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:51.163166    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 17:40:52.211058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.211020    2559 generic.go:356] "Generic (PLEG): container finished" podID="fbb06f19-2d89-470a-a913-68f7493487e2" containerID="583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787" exitCode=0
Sep 09 17:40:52.211508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.211093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerDied","Data":"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"}
Sep 09 17:40:52.211508 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.211449    2559 scope.go:117] "RemoveContainer" containerID="583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"
Sep 09 17:40:52.212491 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.212465    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:52.212542 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.212529    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:52.212581 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:52.212560    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:40:53.218243 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:53.218211    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerStarted","Data":"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"}
Sep 09 17:40:53.741672 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:53.741631    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:53.741869 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:53.741838    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 17:40:53.741947 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:53.741895    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 17:40:54.742225 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:54.742190    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 17:40:54.742592 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:54.742250    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 17:40:55.742043 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:55.742006    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 17:40:55.742213 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:55.742064    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 17:40:56.742419 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:56.742383    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 17:40:56.742819 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:56.742442    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 17:40:57.742433 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:57.742394    2559 patch_prober.go:28] interesting pod/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 17:40:57.742920 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:57.742460    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 17:40:58.745287 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:58.745256    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:58.745843 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:58.745543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:40:58.746230 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:40:58.746215    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:41:00.038618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:00.038516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:04.325897 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:04.325864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:27.208610 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:27.208572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:34.287520 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:34.287485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:39.686016 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:39.685946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:39.837617 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:39.837577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:39.899939 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:39.899866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:39.965057 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:39.964947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:40.028382 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:40.028346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:40.085774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:40.085745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:43.438518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:43.438476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:44.826744 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:44.826707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:44.881141 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:44.881113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:41:48.464667 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:41:48.464625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:09.096939 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:09.096909    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:42:09.098956 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:09.098935    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:42:25.187321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:25.187264    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:28.634311 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:28.634277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:30.765335 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:30.765248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:36.527170 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:36.527134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:36.787624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:36.787541    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:42:36.787797 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:36.787757    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy" containerID="cri-o://a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8" gracePeriod=30
Sep 09 17:42:37.338981 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:37.338941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:37.440158 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:37.440113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:38.092711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:38.092678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:38.191363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:38.191328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:38.292073 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:38.292042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:38.943687 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:38.943642    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:39.049331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:39.049293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:39.143870 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:39.143832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:40.449178 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:40.449146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:42.044187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.044162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:42:42.070093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070030    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070068    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070166    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070255    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx8lr\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket\") pod \"fbb06f19-2d89-470a-a913-68f7493487e2\" (UID: \"fbb06f19-2d89-470a-a913-68f7493487e2\") "
Sep 09 17:42:42.070606 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070278    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:42:42.070671 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070609    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:42:42.070671 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070523    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:42:42.070871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070748    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.070871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070769    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb06f19-2d89-470a-a913-68f7493487e2-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.070871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070781    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.070871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070781    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:42:42.070871 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.070794    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:42:42.072915 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.072885    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:42:42.073069 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.073043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr" (OuterVolumeSpecName: "kube-api-access-dx8lr") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "kube-api-access-dx8lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:42:42.073222 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.073199    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:42:42.073315 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.073295    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbb06f19-2d89-470a-a913-68f7493487e2" (UID: "fbb06f19-2d89-470a-a913-68f7493487e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:42:42.171269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171237    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.171269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171263    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.171269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171273    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx8lr\" (UniqueName: \"kubernetes.io/projected/fbb06f19-2d89-470a-a913-68f7493487e2-kube-api-access-dx8lr\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.171486 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171283    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.171486 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171292    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb06f19-2d89-470a-a913-68f7493487e2-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.171486 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.171301    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb06f19-2d89-470a-a913-68f7493487e2-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:42:42.753547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.753512    2559 generic.go:356] "Generic (PLEG): container finished" podID="fbb06f19-2d89-470a-a913-68f7493487e2" containerID="a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8" exitCode=0
Sep 09 17:42:42.753547 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.753551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerDied","Data":"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"}
Sep 09 17:42:42.753795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.753560    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"
Sep 09 17:42:42.753795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.753595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv" event={"ID":"fbb06f19-2d89-470a-a913-68f7493487e2","Type":"ContainerDied","Data":"af0f994e2512e345cd398a328fde14c5718fc52b674ce16c06c6a2f9513b5ef7"}
Sep 09 17:42:42.753795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.753619    2559 scope.go:117] "RemoveContainer" containerID="a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"
Sep 09 17:42:42.763922 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.763904    2559 scope.go:117] "RemoveContainer" containerID="583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"
Sep 09 17:42:42.775441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.774037    2559 scope.go:117] "RemoveContainer" containerID="a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"
Sep 09 17:42:42.775441 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:42:42.775379    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8\": container with ID starting with a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8 not found: ID does not exist" containerID="a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"
Sep 09 17:42:42.775441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.775416    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8"} err="failed to get container status \"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8\": rpc error: code = NotFound desc = could not find container \"a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8\": container with ID starting with a3b59860b080949c84fc7e62a98b9fbf4bb1a4f44660ab5046ef5efad02b40a8 not found: ID does not exist"
Sep 09 17:42:42.775441 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.775440    2559 scope.go:117] "RemoveContainer" containerID="583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"
Sep 09 17:42:42.776181 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:42:42.776131    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787\": container with ID starting with 583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787 not found: ID does not exist" containerID="583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"
Sep 09 17:42:42.776181 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.776167    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787"} err="failed to get container status \"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787\": rpc error: code = NotFound desc = could not find container \"583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787\": container with ID starting with 583e51ccac177854ef7f7c2b9c49ad590b50cb1cc29305fb0351a74356414787 not found: ID does not exist"
Sep 09 17:42:42.778698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.778672    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:42:42.783806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:42.783782    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f636a1c6-openshift-default-8fd74d8c6-xwvrv"]
Sep 09 17:42:43.052662 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:43.052583    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" path="/var/lib/kubelet/pods/fbb06f19-2d89-470a-a913-68f7493487e2/volumes"
Sep 09 17:42:46.393020 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:46.392990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:46.460590 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:46.460559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:47.058461 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:47.058428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:50.714183 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:50.714150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:50.815390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:50.815331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:52.470802 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:52.470761    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:52.542712 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:52.542684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:52.847996 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:52.847888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:52.907252 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:52.907218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:52.984331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:52.984304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:42:53.081093 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:42:53.081056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:03.554438 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:03.554399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:04.825879 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:04.825844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:05.590766 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:05.590618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:17.060714 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:17.060674    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:24.855238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:24.855198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:30.507382 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:30.507347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:30.605302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:30.605268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:30.881333 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:30.881255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:31.156244 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156164    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:43:31.156518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156504    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156518    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156528    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156533    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156543    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156549    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156555    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:31.156582 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156560    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:31.156934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156618    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e008bb9d-8a63-4cae-94c6-1d46a19180ea" containerName="istio-proxy"
Sep 09 17:43:31.156934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156625    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:31.156934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.156632    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:31.160471 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.160451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.163008 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.162984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cf91eb-openshift-default-dockercfg-gpc5h\""
Sep 09 17:43:31.171554 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.171528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:43:31.181794 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.181767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:31.199824 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.199792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.199941 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.199835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200047 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200123 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200252 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200324 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98wpc\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200366 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.200416 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.200401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.300889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.300854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.300906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.300940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.300987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98wpc\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301098 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301607 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.301876 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.301846    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.302027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.302006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.304185 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.304162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.304381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.304349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.308727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.308708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.308835 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.308816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98wpc\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc\") pod \"e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") " pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.472724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.472692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:31.745238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.745149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:31.752058 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.752037    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:43:31.754208 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:43:31.754167    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ef70bf_416b_4a9c_b857_55d16dccfddd.slice/crio-ae5845d35766d9ff9b92c04c13eb3a5d33f432e980b33e2eb2b7ef3e1bfd5f55 WatchSource:0}: Error finding container ae5845d35766d9ff9b92c04c13eb3a5d33f432e980b33e2eb2b7ef3e1bfd5f55: Status 404 returned error can't find the container with id ae5845d35766d9ff9b92c04c13eb3a5d33f432e980b33e2eb2b7ef3e1bfd5f55
Sep 09 17:43:31.756902 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.756864    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:31.757027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.756931    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:31.757027 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.756981    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:31.977579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.977542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerStarted","Data":"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"}
Sep 09 17:43:31.977769 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.977613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerStarted","Data":"ae5845d35766d9ff9b92c04c13eb3a5d33f432e980b33e2eb2b7ef3e1bfd5f55"}
Sep 09 17:43:31.999334 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:31.999231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podStartSLOduration=0.999212894 podStartE2EDuration="999.212894ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:43:31.997430663 +0000 UTC m=+1583.415027825" watchObservedRunningTime="2026-09-09 17:43:31.999212894 +0000 UTC m=+1583.416810045"
Sep 09 17:43:32.473269 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:32.473236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:32.477925 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:32.477901    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:32.982219 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:32.982190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:32.983192 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:32.983174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:33.986509 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:33.986471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:34.052156 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:34.052126    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:35.129117 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:35.129089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:35.228484 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:35.228443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:35.597360 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:35.597328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:35.707679 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:35.707643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:35.793301 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:35.793257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:48.832272 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:48.831062    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:36968->10.134.0.47:15021: read: connection reset by peer" start-of-body=
Sep 09 17:43:48.832272 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:48.831149    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:36968->10.134.0.47:15021: read: connection reset by peer"
Sep 09 17:43:49.062284 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.062210    2559 generic.go:356] "Generic (PLEG): container finished" podID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerID="93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba" exitCode=0
Sep 09 17:43:49.062419 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.062283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerDied","Data":"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"}
Sep 09 17:43:49.062677 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.062662    2559 scope.go:117] "RemoveContainer" containerID="93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"
Sep 09 17:43:49.063724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.063698    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:49.063781 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.063760    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:49.063817 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:49.063789    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:43:50.069005 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:50.068946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerStarted","Data":"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"}
Sep 09 17:43:50.473348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:50.473308    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:50.476202 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:50.476162    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 17:43:50.476361 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:50.476231    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 17:43:51.473477 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:51.473438    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 17:43:51.473879 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:51.473491    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 17:43:52.473197 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:52.473162    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 17:43:52.473370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:52.473215    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 17:43:53.473148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:53.473109    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 17:43:53.473534 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:53.473165    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 17:43:54.473860 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:54.473823    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 17:43:54.474277 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:54.473873    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 17:43:55.476872 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:55.476839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:55.477261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:55.477224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:55.477944 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:55.477924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:43:59.012889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.012849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:43:59.789019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.788979    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:43:59.789556 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.789534    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:59.789556 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.789558    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:59.789740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.789650    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb06f19-2d89-470a-a913-68f7493487e2" containerName="istio-proxy"
Sep 09 17:43:59.789740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.789665    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f831f33-a6ca-4bc0-afc9-1928aa52db6e" containerName="istio-proxy"
Sep 09 17:43:59.793291 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.793264    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.795727 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.795692    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ecf58e-openshift-default-dockercfg-ffngg\""
Sep 09 17:43:59.807129 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.807099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:43:59.903516 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:43:59.903930 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:43:59.903839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-927xz\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005353 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-927xz\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.005991 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.005830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.006062 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.006041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.006143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.006122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.006260 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.006238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.006363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.006347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.007922 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.007902    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.008432 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.008413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.012840 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.012818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.012939 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.012855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-927xz\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz\") pod \"e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") " pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.020852 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.020824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:00.107226 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.107127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:00.122552 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.122510    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:00.332903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.332867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:00.384010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.383985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:44:00.385664 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:44:00.385636    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a45effd_e5b6_486c_aaf2_62b6da02f63a.slice/crio-dabb3498055a0f845d6f90d0afa13867b4a83fbd13cf10cdd78f4a794e1f1222 WatchSource:0}: Error finding container dabb3498055a0f845d6f90d0afa13867b4a83fbd13cf10cdd78f4a794e1f1222: Status 404 returned error can't find the container with id dabb3498055a0f845d6f90d0afa13867b4a83fbd13cf10cdd78f4a794e1f1222
Sep 09 17:44:00.387909 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.387878    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:00.387986 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.387942    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:00.388029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:00.387989    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:01.124740 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:01.124697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerStarted","Data":"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"}
Sep 09 17:44:01.125148 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:01.124762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerStarted","Data":"dabb3498055a0f845d6f90d0afa13867b4a83fbd13cf10cdd78f4a794e1f1222"}
Sep 09 17:44:01.144976 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:01.144908    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podStartSLOduration=2.144893386 podStartE2EDuration="2.144893386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:01.143137588 +0000 UTC m=+1612.560734736" watchObservedRunningTime="2026-09-09 17:44:01.144893386 +0000 UTC m=+1612.562490535"
Sep 09 17:44:02.108032 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:02.107998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:02.113782 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:02.113755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:02.129972 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:02.129930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:02.130694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:02.130678    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:03.051127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:03.051079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:03.143669 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:03.143634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:03.244205 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:03.244168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:03.746929 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:03.746896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:04.212004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:04.211956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:04.312154 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:04.312119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:04.413067 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:04.413023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:04.791370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:04.791344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:04.880308 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:04.880270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:21.231656 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.231615    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerID="fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2" exitCode=0
Sep 09 17:44:21.232082 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.231686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerDied","Data":"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"}
Sep 09 17:44:21.232128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.232094    2559 scope.go:117] "RemoveContainer" containerID="fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"
Sep 09 17:44:21.233271 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.233244    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:21.233341 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.233311    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:21.233381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:21.233342    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 17:44:22.238239 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:22.238203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerStarted","Data":"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"}
Sep 09 17:44:23.107949 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:23.107914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:23.108151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:23.108108    2559 patch_prober.go:28] interesting pod/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 09 17:44:23.108195 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:23.108156    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 09 17:44:24.108317 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:24.108273    2559 patch_prober.go:28] interesting pod/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 09 17:44:24.108719 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:24.108347    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 09 17:44:25.107825 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:25.107790    2559 patch_prober.go:28] interesting pod/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 09 17:44:25.108039 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:25.107857    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 09 17:44:26.107706 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:26.107666    2559 patch_prober.go:28] interesting pod/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 09 17:44:26.108112 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:26.107728    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 09 17:44:27.107898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:27.107846    2559 patch_prober.go:28] interesting pod/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 09 17:44:27.108307 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:27.107929    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 09 17:44:28.096611 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:28.096572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:28.111584 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:28.111551    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:28.111931 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:28.111887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:28.112566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:28.112549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:44:31.176743 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:31.176707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:45.924850 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:45.924817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:46.525388 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:46.525357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:46.624790 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:46.624751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:46.696174 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:46.696137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:46.752552 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:46.752520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:47.065329 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:47.065286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:48.523223 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:48.523186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:52.853026 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:52.852993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:53.073059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:53.073023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:53.081505 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:53.081478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:44:53.081736 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:53.081711    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" containerID="cri-o://84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c" gracePeriod=30
Sep 09 17:44:53.129151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:53.129067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:53.682639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:53.682606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:44:55.479748 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:55.479702    2559 patch_prober.go:28] interesting pod/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 17:44:55.480140 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:55.479759    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 17:44:58.332984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.332939    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:44:58.418107 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.418074    2559 generic.go:356] "Generic (PLEG): container finished" podID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerID="84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c" exitCode=0
Sep 09 17:44:58.418265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.418118    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"
Sep 09 17:44:58.418265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.418129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerDied","Data":"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"}
Sep 09 17:44:58.418265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.418177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv" event={"ID":"19ef70bf-416b-4a9c-b857-55d16dccfddd","Type":"ContainerDied","Data":"ae5845d35766d9ff9b92c04c13eb3a5d33f432e980b33e2eb2b7ef3e1bfd5f55"}
Sep 09 17:44:58.418265 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.418198    2559 scope.go:117] "RemoveContainer" containerID="84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"
Sep 09 17:44:58.427103 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.427084    2559 scope.go:117] "RemoveContainer" containerID="93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"
Sep 09 17:44:58.435050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.435032    2559 scope.go:117] "RemoveContainer" containerID="84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"
Sep 09 17:44:58.435329 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:44:58.435309    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c\": container with ID starting with 84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c not found: ID does not exist" containerID="84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"
Sep 09 17:44:58.435456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.435339    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c"} err="failed to get container status \"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c\": rpc error: code = NotFound desc = could not find container \"84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c\": container with ID starting with 84baa98354dc4e5930722aef74c3464b0c0f4699fb16311d00bedb232d21f25c not found: ID does not exist"
Sep 09 17:44:58.435456 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.435358    2559 scope.go:117] "RemoveContainer" containerID="93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"
Sep 09 17:44:58.435607 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:44:58.435593    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba\": container with ID starting with 93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba not found: ID does not exist" containerID="93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"
Sep 09 17:44:58.435652 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.435610    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba"} err="failed to get container status \"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba\": rpc error: code = NotFound desc = could not find container \"93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba\": container with ID starting with 93e2f8ac7b440d6b094642fdef1d76a2d2e8b7a034701bd7b2b11b1153e139ba not found: ID does not exist"
Sep 09 17:44:58.456104 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456084    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456201 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456178    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456241 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456218    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98wpc\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456280 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456247    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456362 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456336    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456439 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456418    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456485    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456495 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:44:58.456608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456521    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:44:58.456608 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456574    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket\") pod \"19ef70bf-416b-4a9c-b857-55d16dccfddd\" (UID: \"19ef70bf-416b-4a9c-b857-55d16dccfddd\") "
Sep 09 17:44:58.456774 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456672    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data" (OuterVolumeSpecName: "istio-data") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:44:58.456855 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:44:58.456981 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.456931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:44:58.457189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.457137    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.457189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.457161    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.457189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.457176    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.457189 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.457188    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.457445 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.457203    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef70bf-416b-4a9c-b857-55d16dccfddd-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.458566 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.458543    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc" (OuterVolumeSpecName: "kube-api-access-98wpc") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "kube-api-access-98wpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:44:58.458655 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.458588    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token" (OuterVolumeSpecName: "istio-token") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:44:58.458704 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.458671    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:44:58.458785 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.458768    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19ef70bf-416b-4a9c-b857-55d16dccfddd" (UID: "19ef70bf-416b-4a9c-b857-55d16dccfddd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:44:58.558571 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.558541    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.558571 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.558567    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98wpc\" (UniqueName: \"kubernetes.io/projected/19ef70bf-416b-4a9c-b857-55d16dccfddd-kube-api-access-98wpc\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.558571 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.558576    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.558754 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.558585    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef70bf-416b-4a9c-b857-55d16dccfddd-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:44:58.741658 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.741632    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:44:58.745247 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:58.745222    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cf91eb-openshift-default-dcf8f68d8-2tpdv"]
Sep 09 17:44:59.052777 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:44:59.052700    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" path="/var/lib/kubelet/pods/19ef70bf-416b-4a9c-b857-55d16dccfddd/volumes"
Sep 09 17:45:00.139337 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.139291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"]
Sep 09 17:45:00.139887 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.139864    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.139984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.139891    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.140050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.140017    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.140050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.140034    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.143152 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.143129    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"]
Sep 09 17:45:00.143297 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.143248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"
Sep 09 17:45:00.143452 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.143440    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.143452 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.143452    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ef70bf-416b-4a9c-b857-55d16dccfddd" containerName="istio-proxy"
Sep 09 17:45:00.145130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.145114    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"
Sep 09 17:45:00.145771 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.145753    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9x8dp\""
Sep 09 17:45:00.152491 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.152471    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"]
Sep 09 17:45:00.154468 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.154447    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"]
Sep 09 17:45:00.156044 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.156025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"
Sep 09 17:45:00.174128 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.174100    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"
Sep 09 17:45:00.451749 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.451721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"]
Sep 09 17:45:00.454257 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:45:00.454228    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f64382_af2e_40f5_a5b3_7384d7a156ae.slice/crio-a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7 WatchSource:0}: Error finding container a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7: Status 404 returned error can't find the container with id a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7
Sep 09 17:45:00.456297 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.456276    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 17:45:00.464821 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:00.464796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"]
Sep 09 17:45:00.466521 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:45:00.466500    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d02d50_81bc_4b31_a76f_83fcd5974185.slice/crio-31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98 WatchSource:0}: Error finding container 31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98: Status 404 returned error can't find the container with id 31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98
Sep 09 17:45:01.435363 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:01.435311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7" event={"ID":"f2f64382-af2e-40f5-a5b3-7384d7a156ae","Type":"ContainerStarted","Data":"a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7"}
Sep 09 17:45:01.436717 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:01.436676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz" event={"ID":"e8d02d50-81bc-4b31-a76f-83fcd5974185","Type":"ContainerStarted","Data":"31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98"}
Sep 09 17:45:03.449324 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:03.449287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7" event={"ID":"f2f64382-af2e-40f5-a5b3-7384d7a156ae","Type":"ContainerStarted","Data":"2908706c49661290a21f5dbc2100593b1d10e416152334e15e4c0dc32c8b3182"}
Sep 09 17:45:03.450866 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:03.450840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz" event={"ID":"e8d02d50-81bc-4b31-a76f-83fcd5974185","Type":"ContainerStarted","Data":"029d412e22d68659018ab8210c803a73050d4b9dbf5b32348e90d496987acb2d"}
Sep 09 17:45:03.464883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:03.464831    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7" podStartSLOduration=1.256912795 podStartE2EDuration="3.464817886s" totalImagesPullingTime="2.207905091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:45:03.463038275 +0000 UTC m=+1674.880635425" watchObservedRunningTime="2026-09-09 17:45:03.464817886 +0000 UTC m=+1674.882415035"
Sep 09 17:45:03.476828 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:03.476786    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz" podStartSLOduration=1.276668975 podStartE2EDuration="3.476773589s" totalImagesPullingTime="2.200104614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:45:03.476343534 +0000 UTC m=+1674.893940684" watchObservedRunningTime="2026-09-09 17:45:03.476773589 +0000 UTC m=+1674.894370738"
Sep 09 17:45:04.457348 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:04.457317    2559 generic.go:356] "Generic (PLEG): container finished" podID="e8d02d50-81bc-4b31-a76f-83fcd5974185" containerID="029d412e22d68659018ab8210c803a73050d4b9dbf5b32348e90d496987acb2d" exitCode=0
Sep 09 17:45:04.457782 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:04.457408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz" event={"ID":"e8d02d50-81bc-4b31-a76f-83fcd5974185","Type":"ContainerDied","Data":"029d412e22d68659018ab8210c803a73050d4b9dbf5b32348e90d496987acb2d"}
Sep 09 17:45:04.458988 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:04.458946    2559 generic.go:356] "Generic (PLEG): container finished" podID="f2f64382-af2e-40f5-a5b3-7384d7a156ae" containerID="2908706c49661290a21f5dbc2100593b1d10e416152334e15e4c0dc32c8b3182" exitCode=0
Sep 09 17:45:04.459105 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:04.459001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7" event={"ID":"f2f64382-af2e-40f5-a5b3-7384d7a156ae","Type":"ContainerDied","Data":"2908706c49661290a21f5dbc2100593b1d10e416152334e15e4c0dc32c8b3182"}
Sep 09 17:45:05.609597 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:05.609566    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"
Sep 09 17:45:05.639937 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:05.639910    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"
Sep 09 17:45:06.469257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.469224    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"
Sep 09 17:45:06.469257 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.469240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7" event={"ID":"f2f64382-af2e-40f5-a5b3-7384d7a156ae","Type":"ContainerDied","Data":"a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7"}
Sep 09 17:45:06.469450 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.469283    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2d9d0066e85250f6393c927d171da9cd2361f000665191e56f9a1f7af77b7d7"
Sep 09 17:45:06.470593 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.470563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz" event={"ID":"e8d02d50-81bc-4b31-a76f-83fcd5974185","Type":"ContainerDied","Data":"31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98"}
Sep 09 17:45:06.470593 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.470582    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816265-wl6cz"
Sep 09 17:45:06.470764 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:06.470608    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31c861781d75b3c79a71c4731c1576b4f6464bf876eb4bd739798418ae943b98"
Sep 09 17:45:09.035831 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:09.035799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:09.091707 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:09.091671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:09.181473 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:09.181442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:09.259698 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:09.259611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:09.584755 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:09.584727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:14.704642 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:14.704601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:15.271322 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:15.271282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:15.387791 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:15.387747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:15.512563 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:15.512530    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:45:15.512770 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:15.512744    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy" containerID="cri-o://bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e" gracePeriod=30
Sep 09 17:45:15.536331 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:15.536260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:16.026367 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:16.026331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:16.714338 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:16.714302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:17.494550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:17.494508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:20.770320 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.770297    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:45:20.872844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.872767    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-927xz\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.872844 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.872819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.872851    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873050 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873106    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873142 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873134    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:20.873342 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873287    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873342 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs\") pod \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\" (UID: \"3a45effd-e5b6-486c-aaf2-62b6da02f63a\") "
Sep 09 17:45:20.873455 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:45:20.873558 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:20.873711 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:20.873826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873719    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:20.873826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873757    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.873826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873772    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.873826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.873786    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.875179 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.875160    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:20.875526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.875510    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:20.875685 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.875666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz" (OuterVolumeSpecName: "kube-api-access-927xz") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "kube-api-access-927xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:20.875724 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.875679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a45effd-e5b6-486c-aaf2-62b6da02f63a" (UID: "3a45effd-e5b6-486c-aaf2-62b6da02f63a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:45:20.975004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.974952    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.975004 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.975004    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.975151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.975014    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.975151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.975024    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-927xz\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-kube-api-access-927xz\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.975151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.975032    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:20.975151 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:20.975041    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a45effd-e5b6-486c-aaf2-62b6da02f63a-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:21.547043 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.547008    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerID="bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e" exitCode=0
Sep 09 17:45:21.547238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.547080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerDied","Data":"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"}
Sep 09 17:45:21.547238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.547082    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"
Sep 09 17:45:21.547238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.547124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc" event={"ID":"3a45effd-e5b6-486c-aaf2-62b6da02f63a","Type":"ContainerDied","Data":"dabb3498055a0f845d6f90d0afa13867b4a83fbd13cf10cdd78f4a794e1f1222"}
Sep 09 17:45:21.547238 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.547151    2559 scope.go:117] "RemoveContainer" containerID="bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"
Sep 09 17:45:21.555845 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.555826    2559 scope.go:117] "RemoveContainer" containerID="fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"
Sep 09 17:45:21.563741 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.563628    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:45:21.563795 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.563750    2559 scope.go:117] "RemoveContainer" containerID="bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"
Sep 09 17:45:21.564053 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:21.564032    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e\": container with ID starting with bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e not found: ID does not exist" containerID="bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"
Sep 09 17:45:21.564127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.564058    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e"} err="failed to get container status \"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e\": rpc error: code = NotFound desc = could not find container \"bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e\": container with ID starting with bed8a327957d08c7f0afd94890d73c5975f447be10f50ce7bc8be68a0f83399e not found: ID does not exist"
Sep 09 17:45:21.564127 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.564073    2559 scope.go:117] "RemoveContainer" containerID="fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"
Sep 09 17:45:21.564345 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:21.564330    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2\": container with ID starting with fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2 not found: ID does not exist" containerID="fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"
Sep 09 17:45:21.564396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.564348    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2"} err="failed to get container status \"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2\": rpc error: code = NotFound desc = could not find container \"fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2\": container with ID starting with fcbe523ce798426170b1178ae111e87f4b16370da539f5652d56d2df836157d2 not found: ID does not exist"
Sep 09 17:45:21.567197 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:21.567176    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ecf58e-openshift-default-6f89c8c546-lh9zc"]
Sep 09 17:45:23.052563 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:23.052526    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" path="/var/lib/kubelet/pods/3a45effd-e5b6-486c-aaf2-62b6da02f63a/volumes"
Sep 09 17:45:26.319601 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:26.319567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:26.680832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:26.680788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:26.830518 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:26.830485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:26.930029 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:26.929992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:32.847785 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:32.847701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:32.948275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:32.948235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:33.093617 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:33.093588    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:45:33.094083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:33.094055    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy" containerID="cri-o://0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb" gracePeriod=30
Sep 09 17:45:33.193463 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:33.193415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:33.725898 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:33.725860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:38.355588 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.355562    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:45:38.429624 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429596    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429634    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429667    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429741    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.429881 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429812    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbmcj\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj\") pod \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\" (UID: \"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3\") "
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.429893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430128    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430218    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430224    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430240    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430241    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:45:38.430364 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.430317    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:38.431927 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.431899    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:45:38.432119 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.432102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:38.432179 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.432120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:38.432440 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.432425    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj" (OuterVolumeSpecName: "kube-api-access-kbmcj") pod "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" (UID: "8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3"). InnerVolumeSpecName "kube-api-access-kbmcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:38.530750 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530726    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530750 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530748    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530757    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530766    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbmcj\" (UniqueName: \"kubernetes.io/projected/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-kube-api-access-kbmcj\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530774    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530782    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.530889 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.530789    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:38.629806 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.629780    2559 generic.go:356] "Generic (PLEG): container finished" podID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerID="0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb" exitCode=0
Sep 09 17:45:38.629903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.629830    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"
Sep 09 17:45:38.629903 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.629861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerDied","Data":"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"}
Sep 09 17:45:38.630031 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.629914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk" event={"ID":"8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3","Type":"ContainerDied","Data":"4477999f9ed7ccff9a549f38007d22502dd8e00aa95c50dfb268fff08e9c96ac"}
Sep 09 17:45:38.630031 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.629935    2559 scope.go:117] "RemoveContainer" containerID="0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"
Sep 09 17:45:38.639056 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.639040    2559 scope.go:117] "RemoveContainer" containerID="69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"
Sep 09 17:45:38.647158 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.647142    2559 scope.go:117] "RemoveContainer" containerID="0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"
Sep 09 17:45:38.647402 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:38.647381    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb\": container with ID starting with 0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb not found: ID does not exist" containerID="0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"
Sep 09 17:45:38.647474 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.647413    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb"} err="failed to get container status \"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb\": rpc error: code = NotFound desc = could not find container \"0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb\": container with ID starting with 0b83fc59399c4335ca1fd5cbca809c40946cc549c2844f86c946f4a5dcdfd5bb not found: ID does not exist"
Sep 09 17:45:38.647474 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.647433    2559 scope.go:117] "RemoveContainer" containerID="69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"
Sep 09 17:45:38.647699 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:38.647680    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6\": container with ID starting with 69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6 not found: ID does not exist" containerID="69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"
Sep 09 17:45:38.647738 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.647706    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6"} err="failed to get container status \"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6\": rpc error: code = NotFound desc = could not find container \"69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6\": container with ID starting with 69d4285b8cb673724a82eb8cc5cb647dd64e5722d82f1ee120f1fc19bc829fb6 not found: ID does not exist"
Sep 09 17:45:38.650654 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.650631    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:45:38.656614 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:38.656593    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-6b44e3-openshift-default-795d95fc78-4jdlk"]
Sep 09 17:45:39.052052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:39.052019    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" path="/var/lib/kubelet/pods/8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3/volumes"
Sep 09 17:45:43.950144 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:43.950112    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"]
Sep 09 17:45:43.952829 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:43.952805    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-607751-29816265-7mls7"]
Sep 09 17:45:44.041113 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:44.041080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:44.183526 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:44.183493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:44.235394 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:44.235279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:44.511023 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:44.510926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:45.051933 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:45.051903    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f64382-af2e-40f5-a5b3-7384d7a156ae" path="/var/lib/kubelet/pods/f2f64382-af2e-40f5-a5b3-7384d7a156ae/volumes"
Sep 09 17:45:50.426038 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:50.425999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:50.488010 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:50.487978    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:50.645762 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:50.645730    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:45:50.645987 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:50.645947    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy" containerID="cri-o://b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592" gracePeriod=30
Sep 09 17:45:50.683512 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:50.683421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:45:55.891752 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.891720    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:45:55.991429 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991403    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991622 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj47m\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991700 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991643    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991769 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991708    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991769 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991870 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991780    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991931 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991866    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.991931 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991900    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.992089 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.991940    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data\") pod \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\" (UID: \"84d4c4fe-babf-4e46-821d-38ee8fa71ee2\") "
Sep 09 17:45:55.992143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:55.992143 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992123    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:45:55.992409 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992254    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:55.992409 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data" (OuterVolumeSpecName: "istio-data") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:55.992409 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992400    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:55.992572 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992412    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-workload-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:55.992572 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992421    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istiod-ca-cert\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:55.992572 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992430    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-data\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:55.992572 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.992508    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:55.993883 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.993863    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m" (OuterVolumeSpecName: "kube-api-access-gj47m") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "kube-api-access-gj47m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:55.994021 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.993925    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 17:45:55.994484 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.994457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 17:45:55.994535 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:55.994465    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token" (OuterVolumeSpecName: "istio-token") pod "84d4c4fe-babf-4e46-821d-38ee8fa71ee2" (UID: "84d4c4fe-babf-4e46-821d-38ee8fa71ee2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:45:56.093549 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.093519    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-envoy\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:56.093692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.093557    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-credential-socket\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:56.093692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.093567    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-podinfo\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:56.093692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.093581    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj47m\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-kube-api-access-gj47m\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:56.093692 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.093591    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d4c4fe-babf-4e46-821d-38ee8fa71ee2-istio-token\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:45:56.718085 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.718053    2559 generic.go:356] "Generic (PLEG): container finished" podID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerID="b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592" exitCode=0
Sep 09 17:45:56.718240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.718102    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"
Sep 09 17:45:56.718240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.718147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerDied","Data":"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"}
Sep 09 17:45:56.718240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.718205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8" event={"ID":"84d4c4fe-babf-4e46-821d-38ee8fa71ee2","Type":"ContainerDied","Data":"ca06b29945e0f98ca0423feb5d65c8ec313b2e391b257fdfb5efb9e6b627dce1"}
Sep 09 17:45:56.718240 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.718227    2559 scope.go:117] "RemoveContainer" containerID="b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"
Sep 09 17:45:56.732430 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.731654    2559 scope.go:117] "RemoveContainer" containerID="55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"
Sep 09 17:45:56.740234 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.740215    2559 scope.go:117] "RemoveContainer" containerID="b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"
Sep 09 17:45:56.740479 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:56.740460    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592\": container with ID starting with b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592 not found: ID does not exist" containerID="b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"
Sep 09 17:45:56.740544 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.740486    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592"} err="failed to get container status \"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592\": rpc error: code = NotFound desc = could not find container \"b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592\": container with ID starting with b21ff00faadf277a9a69d01f1e688fd59bcf7dc2208d8b8a11b6d2601cd0f592 not found: ID does not exist"
Sep 09 17:45:56.740544 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.740504    2559 scope.go:117] "RemoveContainer" containerID="55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"
Sep 09 17:45:56.740839 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:45:56.740826    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97\": container with ID starting with 55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97 not found: ID does not exist" containerID="55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"
Sep 09 17:45:56.740900 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.740843    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97"} err="failed to get container status \"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97\": rpc error: code = NotFound desc = could not find container \"55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97\": container with ID starting with 55c185b9124fd4555288134f6d0a69eefb5c61bd9afefaf6b0f12b64d8f40c97 not found: ID does not exist"
Sep 09 17:45:56.745564 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.745532    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:45:56.749097 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:56.749077    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-607751-openshift-default-79455f876-zb4j8"]
Sep 09 17:45:57.052471 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:45:57.052392    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" path="/var/lib/kubelet/pods/84d4c4fe-babf-4e46-821d-38ee8fa71ee2/volumes"
Sep 09 17:47:09.126275 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:47:09.126247    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:47:09.130299 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:47:09.130275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:47:15.701437 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:47:15.701400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:47:16.861914 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:47:16.861877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:47:18.388474 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:47:18.388434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:48:28.883132 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:48:28.883088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:48:30.374083 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:48:30.374006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:00.918902 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:00.918823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:08.347381 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:08.347343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:08.798454 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:08.798407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:20.816600 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:20.816562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:46.781923 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:46.781876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:50:48.211514 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:50:48.211485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:51:09.313550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:09.313517    2559 scope.go:117] "RemoveContainer" containerID="2908706c49661290a21f5dbc2100593b1d10e416152334e15e4c0dc32c8b3182"
Sep 09 17:51:21.127314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127279    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"]
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127601    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127612    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127623    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d02d50-81bc-4b31-a76f-83fcd5974185" containerName="cleanup"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127629    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d02d50-81bc-4b31-a76f-83fcd5974185" containerName="cleanup"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127643    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127648    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127658    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127665    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127670    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f64382-af2e-40f5-a5b3-7384d7a156ae" containerName="cleanup"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f64382-af2e-40f5-a5b3-7384d7a156ae" containerName="cleanup"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127683    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127689    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127740    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127747    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127754    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127760    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f64382-af2e-40f5-a5b3-7384d7a156ae" containerName="cleanup"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127765    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ceaa8a3-035f-4bbf-a1ba-7c94795be4e3" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127772    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:51:21.127809 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.127778    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d02d50-81bc-4b31-a76f-83fcd5974185" containerName="cleanup"
Sep 09 17:51:21.130731 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.130712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.141236 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.141210    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"]
Sep 09 17:51:21.171169 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.171144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svljg\" (UniqueName: \"kubernetes.io/projected/a13e31c6-3e30-4c87-af9b-638f19772741-kube-api-access-svljg\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.171311 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.171184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-maas-api-tls\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.171311 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.171199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13e31c6-3e30-4c87-af9b-638f19772741-openshift-service-ca\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.171435 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.171338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-metrics-certs\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.271837 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.271803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svljg\" (UniqueName: \"kubernetes.io/projected/a13e31c6-3e30-4c87-af9b-638f19772741-kube-api-access-svljg\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.272019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.271844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-maas-api-tls\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.272019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.271863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13e31c6-3e30-4c87-af9b-638f19772741-openshift-service-ca\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.272019 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.271923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-metrics-certs\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.272627 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.272555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13e31c6-3e30-4c87-af9b-638f19772741-openshift-service-ca\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.274390 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.274370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-maas-api-tls\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.274482 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.274427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13e31c6-3e30-4c87-af9b-638f19772741-metrics-certs\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.279499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.279477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svljg\" (UniqueName: \"kubernetes.io/projected/a13e31c6-3e30-4c87-af9b-638f19772741-kube-api-access-svljg\") pod \"maas-api-7cfd4ff64b-vvr62\" (UID: \"a13e31c6-3e30-4c87-af9b-638f19772741\") " pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.441214 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.441181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:21.715733 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.715703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"]
Sep 09 17:51:21.717993 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:51:21.717952    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13e31c6_3e30_4c87_af9b_638f19772741.slice/crio-9284b3b1e39f6bd76d293ad9b7e7b3e35e1ddb473cf5eb91a1c505d74a4c31ce WatchSource:0}: Error finding container 9284b3b1e39f6bd76d293ad9b7e7b3e35e1ddb473cf5eb91a1c505d74a4c31ce: Status 404 returned error can't find the container with id 9284b3b1e39f6bd76d293ad9b7e7b3e35e1ddb473cf5eb91a1c505d74a4c31ce
Sep 09 17:51:21.719798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:21.719776    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 17:51:22.174431 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:22.174391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62" event={"ID":"a13e31c6-3e30-4c87-af9b-638f19772741","Type":"ContainerStarted","Data":"7286d6a642747133dbaa090512fe96b7a93ef3629ec67a5c3346edf15d4159e5"}
Sep 09 17:51:22.174781 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:22.174490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62" event={"ID":"a13e31c6-3e30-4c87-af9b-638f19772741","Type":"ContainerStarted","Data":"9284b3b1e39f6bd76d293ad9b7e7b3e35e1ddb473cf5eb91a1c505d74a4c31ce"}
Sep 09 17:51:22.174781 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:22.174525    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:22.191507 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:22.191461    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62" podStartSLOduration=0.854975277 podStartE2EDuration="1.191447422s" totalImagesPullingTime="336.472145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:51:22.190020718 +0000 UTC m=+2053.607617868" watchObservedRunningTime="2026-09-09 17:51:22.191447422 +0000 UTC m=+2053.609044571"
Sep 09 17:51:28.186130 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:28.186102    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7cfd4ff64b-vvr62"
Sep 09 17:51:28.227773 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:28.227734    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:51:28.228040 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:28.227999    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerName="maas-api" containerID="cri-o://f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125" gracePeriod=30
Sep 09 17:51:29.260262 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.260219    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.28:8443/health\": dial tcp 10.134.0.28:8443: connect: connection refused"
Sep 09 17:51:29.465370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.465345    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:51:29.545952 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.545866    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rljz6\" (UniqueName: \"kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6\") pod \"e845f788-e9f1-47bf-838a-bb80b8957d4e\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") "
Sep 09 17:51:29.545952 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.545915    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca\") pod \"e845f788-e9f1-47bf-838a-bb80b8957d4e\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") "
Sep 09 17:51:29.546187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.546022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") pod \"e845f788-e9f1-47bf-838a-bb80b8957d4e\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") "
Sep 09 17:51:29.546187 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.546048    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") pod \"e845f788-e9f1-47bf-838a-bb80b8957d4e\" (UID: \"e845f788-e9f1-47bf-838a-bb80b8957d4e\") "
Sep 09 17:51:29.546314 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.546283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e845f788-e9f1-47bf-838a-bb80b8957d4e" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 17:51:29.548299 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.548269    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e845f788-e9f1-47bf-838a-bb80b8957d4e" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:51:29.548401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.548301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6" (OuterVolumeSpecName: "kube-api-access-rljz6") pod "e845f788-e9f1-47bf-838a-bb80b8957d4e" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e"). InnerVolumeSpecName "kube-api-access-rljz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 17:51:29.548401 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.548311    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e845f788-e9f1-47bf-838a-bb80b8957d4e" (UID: "e845f788-e9f1-47bf-838a-bb80b8957d4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 17:51:29.647412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.647383    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-maas-api-tls\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:51:29.647412 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.647410    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e845f788-e9f1-47bf-838a-bb80b8957d4e-metrics-certs\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:51:29.647579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.647419    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rljz6\" (UniqueName: \"kubernetes.io/projected/e845f788-e9f1-47bf-838a-bb80b8957d4e-kube-api-access-rljz6\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:51:29.647579 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:29.647428    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e845f788-e9f1-47bf-838a-bb80b8957d4e-openshift-service-ca\") on node \"ip-10-0-130-60.ec2.internal\" DevicePath \"\""
Sep 09 17:51:30.209756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.209722    2559 generic.go:356] "Generic (PLEG): container finished" podID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerID="f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125" exitCode=0
Sep 09 17:51:30.209756 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.209758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"
Sep 09 17:51:30.210056 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.209816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" event={"ID":"e845f788-e9f1-47bf-838a-bb80b8957d4e","Type":"ContainerDied","Data":"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"}
Sep 09 17:51:30.210056 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.209870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6" event={"ID":"e845f788-e9f1-47bf-838a-bb80b8957d4e","Type":"ContainerDied","Data":"d53af281fc9557c663aa15e5225eb6b9ddaff82d2a9d39c8bdc18556f6b24816"}
Sep 09 17:51:30.210056 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.209897    2559 scope.go:117] "RemoveContainer" containerID="f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"
Sep 09 17:51:30.218838 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.218820    2559 scope.go:117] "RemoveContainer" containerID="f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"
Sep 09 17:51:30.219166 ip-10-0-130-60 kubenswrapper[2559]: E0909 17:51:30.219144    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125\": container with ID starting with f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125 not found: ID does not exist" containerID="f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"
Sep 09 17:51:30.219261 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.219171    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125"} err="failed to get container status \"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125\": rpc error: code = NotFound desc = could not find container \"f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125\": container with ID starting with f7e169698ec92c0e71c6fc167e87c79ea7252834678cce46c2789f71299c3125 not found: ID does not exist"
Sep 09 17:51:30.231002 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.230982    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:51:30.234687 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:30.234666    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8458467cb6-6jpd6"]
Sep 09 17:51:31.052283 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:31.052245    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" path="/var/lib/kubelet/pods/e845f788-e9f1-47bf-838a-bb80b8957d4e/volumes"
Sep 09 17:51:47.638985 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:47.638931    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fcrpq_db62dd4d-e49a-4dba-8ddb-7cc93e9f7182/server/0.log"
Sep 09 17:51:47.772086 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:47.772051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kq4qp_2225faca-46d8-4547-8013-eff28b45e45f/manager/0.log"
Sep 09 17:51:48.031182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:48.031157    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdfc9465f-v2lpm_2d0a852f-5122-4510-a417-b640221f8469/copy-manifests/0.log"
Sep 09 17:51:48.037888 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:48.037866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdfc9465f-v2lpm_2d0a852f-5122-4510-a417-b640221f8469/manager/0.log"
Sep 09 17:51:48.646884 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:48.646847    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7cfd4ff64b-vvr62_a13e31c6-3e30-4c87-af9b-638f19772741/maas-api/0.log"
Sep 09 17:51:48.764573 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:48.764535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816265-wl6cz_e8d02d50-81bc-4b31-a76f-83fcd5974185/cleanup/0.log"
Sep 09 17:51:50.812046 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:50.811993    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88_055b139b-632f-431f-928b-4b45b92de054/istio-proxy/0.log"
Sep 09 17:51:50.935319 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:50.935289    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d8d5h_1a346c65-5567-4fd2-9714-fa88c3d60645/discovery/0.log"
Sep 09 17:51:51.669424 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:51.669367    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d6dd55f6-6pkr7_364f5751-5f64-4334-b85a-37e12355d575/router/0.log"
Sep 09 17:51:52.139157 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:52.139082    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9wnxn_f8a68861-2ecc-4a06-9789-57157f6c24b6/main/0.log"
Sep 09 17:51:52.253483 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:52.253449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-9df6r_65ddba0b-ae42-45ec-bb66-f8464c0dd3f4/main/0.log"
Sep 09 17:51:58.553499 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:58.553455    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:51:58.653626 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:51:58.653589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log" limit=1024
Sep 09 17:52:02.568768 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:02.568738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rtgmx_72d0c9b2-8069-453f-b611-a25066960de5/global-pull-secret-syncer/0.log"
Sep 09 17:52:02.617737 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:02.617703    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-np62x_c59119c0-41e0-4461-be60-660e46d89b1d/konnectivity-agent/0.log"
Sep 09 17:52:02.723015 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:02.722987    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-60.ec2.internal_d328caa67c7e9fc54aec218f9841f8a5/haproxy/0.log"
Sep 09 17:52:09.153290 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.153209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:52:09.158282 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.158263    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:52:09.650115 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.650082    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c77d6b755-xmzl9_02aad26f-914f-4add-84a5-747dc40e4683/metrics-server/0.log"
Sep 09 17:52:09.674039 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.674010    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-nnstf_17328082-4c99-4c15-a1e7-b9925b62f9d4/monitoring-plugin/0.log"
Sep 09 17:52:09.885474 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.885448    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjzns_c7e53a13-b062-4ab2-ae39-a0e80813dbef/node-exporter/0.log"
Sep 09 17:52:09.911396 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.911372    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjzns_c7e53a13-b062-4ab2-ae39-a0e80813dbef/kube-rbac-proxy/0.log"
Sep 09 17:52:09.938051 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:09.938027    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjzns_c7e53a13-b062-4ab2-ae39-a0e80813dbef/init-textfile/0.log"
Sep 09 17:52:10.075694 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.075665    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/prometheus/0.log"
Sep 09 17:52:10.104182 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.104158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/config-reloader/0.log"
Sep 09 17:52:10.123875 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.123852    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/thanos-sidecar/0.log"
Sep 09 17:52:10.146798 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.146774    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/kube-rbac-proxy-web/0.log"
Sep 09 17:52:10.166520 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.166499    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/kube-rbac-proxy/0.log"
Sep 09 17:52:10.186018 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.185994    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/kube-rbac-proxy-thanos/0.log"
Sep 09 17:52:10.206426 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:10.206406    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b9afd4-e51f-4c20-bcbe-12b864186723/init-config-reloader/0.log"
Sep 09 17:52:11.857207 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:11.857178    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-fw265_a1bc9880-e88e-489e-b031-4ee1a3c663fd/networking-console-plugin/0.log"
Sep 09 17:52:13.229989 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.229936    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"]
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230287    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerName="maas-api"
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230299    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerName="maas-api"
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230314    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230319    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d4c4fe-babf-4e46-821d-38ee8fa71ee2" containerName="istio-proxy"
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230335    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:52:13.230350 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230341    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:52:13.230539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230390    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a45effd-e5b6-486c-aaf2-62b6da02f63a" containerName="istio-proxy"
Sep 09 17:52:13.230539 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.230401    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e845f788-e9f1-47bf-838a-bb80b8957d4e" containerName="maas-api"
Sep 09 17:52:13.233370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.233349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.235647 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.235627    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k64x\"/\"kube-root-ca.crt\""
Sep 09 17:52:13.235816 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.235757    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k64x\"/\"openshift-service-ca.crt\""
Sep 09 17:52:13.236573 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.236560    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8k64x\"/\"default-dockercfg-f5w8x\""
Sep 09 17:52:13.239794 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.239775    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"]
Sep 09 17:52:13.338245 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.338216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c9z9\" (UniqueName: \"kubernetes.io/projected/9a2dd846-3d66-4b07-812f-46e289bec3ca-kube-api-access-6c9z9\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.338408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.338263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-sys\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.338408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.338285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-lib-modules\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.338408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.338325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-podres\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.338408 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.338357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-proc\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439710 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c9z9\" (UniqueName: \"kubernetes.io/projected/9a2dd846-3d66-4b07-812f-46e289bec3ca-kube-api-access-6c9z9\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-sys\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-lib-modules\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-podres\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-sys\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.439885 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-proc\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.440137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-lib-modules\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.440137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-podres\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.440137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.439940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a2dd846-3d66-4b07-812f-46e289bec3ca-proc\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.446738 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.446715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c9z9\" (UniqueName: \"kubernetes.io/projected/9a2dd846-3d66-4b07-812f-46e289bec3ca-kube-api-access-6c9z9\") pod \"perf-node-gather-daemonset-l8w7l\" (UID: \"9a2dd846-3d66-4b07-812f-46e289bec3ca\") " pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.544059 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.543975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:13.783519 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.783491    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-g5jrv_f1339756-f221-4ea8-bdac-1b91b3a34461/volume-data-source-validator/0.log"
Sep 09 17:52:13.812567 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:13.812500    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"]
Sep 09 17:52:13.816043 ip-10-0-130-60 kubenswrapper[2559]: W0909 17:52:13.816015    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a2dd846_3d66_4b07_812f_46e289bec3ca.slice/crio-23bed24c37fbbe872d8c8c2de4df57c67a447eabfc992969adcbde1980e73ab0 WatchSource:0}: Error finding container 23bed24c37fbbe872d8c8c2de4df57c67a447eabfc992969adcbde1980e73ab0: Status 404 returned error can't find the container with id 23bed24c37fbbe872d8c8c2de4df57c67a447eabfc992969adcbde1980e73ab0
Sep 09 17:52:14.409826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:14.409793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l" event={"ID":"9a2dd846-3d66-4b07-812f-46e289bec3ca","Type":"ContainerStarted","Data":"d9f66388372276dc97aafd210cc9ddc4cc3047bc0cb87b71be12c0cd28f74e2f"}
Sep 09 17:52:14.410255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:14.409848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l" event={"ID":"9a2dd846-3d66-4b07-812f-46e289bec3ca","Type":"ContainerStarted","Data":"23bed24c37fbbe872d8c8c2de4df57c67a447eabfc992969adcbde1980e73ab0"}
Sep 09 17:52:14.410255 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:14.409875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:15.006841 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.006806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2ht2_3e4d10ae-4742-47b4-8ef9-e8150bc3acb7/dns/0.log"
Sep 09 17:52:15.025480 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.025453    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2ht2_3e4d10ae-4742-47b4-8ef9-e8150bc3acb7/kube-rbac-proxy/0.log"
Sep 09 17:52:15.070076 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.070047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvkwc_193c1ede-f459-4d14-b891-065933f64baf/dns-node-resolver/0.log"
Sep 09 17:52:15.593867 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.593833    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5748c46786-p68wg_d465801e-f07c-4a37-b78e-523691aa6973/registry/0.log"
Sep 09 17:52:15.608258 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.608220    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5748c46786-p68wg_d465801e-f07c-4a37-b78e-523691aa6973/registry/1.log"
Sep 09 17:52:15.673984 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:15.673949    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ws7cp_28e7e799-a82e-4bc3-b751-82b3701b04af/node-ca/0.log"
Sep 09 17:52:16.555639 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:16.555608    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88_055b139b-632f-431f-928b-4b45b92de054/istio-proxy/0.log"
Sep 09 17:52:16.882671 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:16.882593    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d8d5h_1a346c65-5567-4fd2-9714-fa88c3d60645/discovery/0.log"
Sep 09 17:52:17.075321 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:17.075284    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d6dd55f6-6pkr7_364f5751-5f64-4334-b85a-37e12355d575/router/0.log"
Sep 09 17:52:17.880457 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:17.880424    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lql8n_f9df9e62-7b30-46f5-937e-7629b918f504/serve-healthcheck-canary/0.log"
Sep 09 17:52:18.359486 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:18.359461    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-p5qz2_3fc45dc0-c198-4be0-861f-b06b2c194d90/insights-operator/0.log"
Sep 09 17:52:18.360380 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:18.360353    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-p5qz2_3fc45dc0-c198-4be0-861f-b06b2c194d90/insights-operator/1.log"
Sep 09 17:52:18.446760 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:18.446733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrqbl_f74c1d6d-7ccd-49b6-a09d-5062fcc71912/kube-rbac-proxy/0.log"
Sep 09 17:52:18.467005 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:18.466979    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrqbl_f74c1d6d-7ccd-49b6-a09d-5062fcc71912/exporter/0.log"
Sep 09 17:52:18.489137 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:18.489117    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrqbl_f74c1d6d-7ccd-49b6-a09d-5062fcc71912/extractor/0.log"
Sep 09 17:52:20.424302 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:20.424275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l"
Sep 09 17:52:20.447052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:20.446999    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8k64x/perf-node-gather-daemonset-l8w7l" podStartSLOduration=7.446985044 podStartE2EDuration="7.446985044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:52:14.425758673 +0000 UTC m=+2105.843355825" watchObservedRunningTime="2026-09-09 17:52:20.446985044 +0000 UTC m=+2111.864582190"
Sep 09 17:52:20.833370 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:20.833277    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fcrpq_db62dd4d-e49a-4dba-8ddb-7cc93e9f7182/server/0.log"
Sep 09 17:52:20.944741 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:20.944710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kq4qp_2225faca-46d8-4547-8013-eff28b45e45f/manager/0.log"
Sep 09 17:52:21.017214 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:21.017179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdfc9465f-v2lpm_2d0a852f-5122-4510-a417-b640221f8469/manager/0.log"
Sep 09 17:52:21.036720 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:21.036689    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdfc9465f-v2lpm_2d0a852f-5122-4510-a417-b640221f8469/copy-manifests/0.log"
Sep 09 17:52:22.238550 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:22.238510    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67d8946886-6lt68_70e406f8-31ce-4f2b-b3f6-213d714f0e29/manager/0.log"
Sep 09 17:52:23.160017 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:23.159985    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88_055b139b-632f-431f-928b-4b45b92de054/istio-proxy/0.log"
Sep 09 17:52:23.481228 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:23.481194    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d8d5h_1a346c65-5567-4fd2-9714-fa88c3d60645/discovery/0.log"
Sep 09 17:52:23.624448 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:23.624364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d6dd55f6-6pkr7_364f5751-5f64-4334-b85a-37e12355d575/router/0.log"
Sep 09 17:52:25.166874 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:25.166828    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xjh88_055b139b-632f-431f-928b-4b45b92de054/istio-proxy/0.log"
Sep 09 17:52:25.485421 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:25.485325    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-d8d5h_1a346c65-5567-4fd2-9714-fa88c3d60645/discovery/0.log"
Sep 09 17:52:25.636562 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:25.636532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d6dd55f6-6pkr7_364f5751-5f64-4334-b85a-37e12355d575/router/0.log"
Sep 09 17:52:28.841733 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.841701    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8s9jj_dac8adea-7679-4725-947e-d06c97790af2/kube-multus/0.log"
Sep 09 17:52:28.864826 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.864802    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/kube-multus-additional-cni-plugins/0.log"
Sep 09 17:52:28.883618 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.883596    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/egress-router-binary-copy/0.log"
Sep 09 17:52:28.903286 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.903259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/cni-plugins/0.log"
Sep 09 17:52:28.921931 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.921909    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/bond-cni-plugin/0.log"
Sep 09 17:52:28.939832 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.939814    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/routeoverride-cni/0.log"
Sep 09 17:52:28.957689 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.957668    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/whereabouts-cni-bincopy/0.log"
Sep 09 17:52:28.975052 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:28.975036    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98rq7_f6305232-c046-439f-91a5-8631ce940e6b/whereabouts-cni/0.log"
Sep 09 17:52:29.367522 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:29.367495    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28drg_53ec7a0d-1db6-4223-b93f-cd12cc19ba12/network-metrics-daemon/0.log"
Sep 09 17:52:29.383830 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:29.383786    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28drg_53ec7a0d-1db6-4223-b93f-cd12cc19ba12/kube-rbac-proxy/0.log"
Sep 09 17:52:30.456891 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.456857    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-controller/0.log"
Sep 09 17:52:30.471728 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.471690    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/1.log"
Sep 09 17:52:30.471728 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.471711    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovn-acl-logging/0.log"
Sep 09 17:52:30.495817 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.495793    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/kube-rbac-proxy-node/0.log"
Sep 09 17:52:30.521934 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.521869    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 17:52:30.536742 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.536719    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/northd/0.log"
Sep 09 17:52:30.555215 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.555191    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/nbdb/0.log"
Sep 09 17:52:30.575162 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.575144    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/sbdb/0.log"
Sep 09 17:52:30.651627 ip-10-0-130-60 kubenswrapper[2559]: I0909 17:52:30.651603    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vctmh_e7380873-1b36-42ad-bf1a-c8389ce43747/ovnkube-controller/0.log"