Jul 07 15:30:03.843353 ip-10-0-132-109 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:30:04.310239 ip-10-0-132-109 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:30:04.310239 ip-10-0-132-109 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:30:04.310239 ip-10-0-132-109 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:30:04.310239 ip-10-0-132-109 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:30:04.310239 ip-10-0-132-109 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:30:04.310853 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.310248    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:30:04.314963 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314945    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.314963 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314964    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314968    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314970    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314973    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314976    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314978    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314981    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314983    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314989    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314993    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314996    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.314998    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315002    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315010    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315013    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315016    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315019    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315022    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315024    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315027    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.315030 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315030    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315033    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315036    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315038    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315041    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315044    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315046    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315049    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315053    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315055    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315058    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315060    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315079    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315083    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315087    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315091    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315094    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315096    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315099    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315101    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315104    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.315520 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315106    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315109    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315114    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315118    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315122    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315125    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315128    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315131    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315134    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315137    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315140    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315143    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315146    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315148    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315151    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315154    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315157    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315159    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315162    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.316012 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315164    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315167    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315170    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315173    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315176    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315179    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315182    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315185    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315187    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315190    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315193    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315195    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315198    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315200    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315203    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315206    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315208    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315210    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315215    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315217    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.316480 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315220    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315222    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315225    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315227    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315230    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315232    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315235    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315237    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315240    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315242    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315245    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315247    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315250    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315252    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315255    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315258    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315262    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.316966 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.315265    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.318140 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318126    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.318140 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318139    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318143    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318152    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318156    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318160    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318164    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318166    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318169    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318172    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318174    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318177    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318180    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318183    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318185    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318188    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318191    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318193    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318196    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318198    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.318202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318200    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318203    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318205    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318208    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318211    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318214    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318217    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318219    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318222    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318224    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318226    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318229    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318231    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318234    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318236    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318239    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318243    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318246    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318248    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318251    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.318657 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318254    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318256    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318258    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318261    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318263    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318266    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318268    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318270    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318273    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318275    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318278    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318280    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318282    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318285    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318289    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318292    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318295    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318297    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318300    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318302    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.319165 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318305    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318307    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318309    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318312    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318314    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318317    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318319    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318321    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318324    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318327    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318330    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318333    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318335    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318338    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318340    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318343    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318348    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318352    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318355    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.319650 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318357    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318360    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318363    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318365    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318368    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318370    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318373    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318376    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318379    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318381    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318384    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318387    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318389    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318392    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318395    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318398    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318400    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318403    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318405    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318407    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.320127 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318765    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318770    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318773    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318776    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318778    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318781    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318784    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318786    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318791    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318794    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318797    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318800    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318804    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318806    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318809    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318812    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318814    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318817    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318819    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318823    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.320602 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318826    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318828    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318831    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318834    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318836    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318838    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318841    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318843    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318846    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318848    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318850    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318853    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318856    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318858    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318861    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318864    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318866    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318870    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318875    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.321125 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318878    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318880    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318882    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318885    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318887    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318890    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318893    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318895    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318897    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318900    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318902    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318905    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318908    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318911    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318914    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318916    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318918    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318921    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318923    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318925    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.321611 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318928    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318930    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318933    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318935    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318938    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318940    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318943    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318945    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318947    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318950    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318952    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318955    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318957    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318960    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318963    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318965    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318968    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318970    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318972    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318975    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.322189 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318977    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318980    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318982    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318985    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318988    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318991    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318994    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318996    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.318999    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319001    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319004    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319008    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319011    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319014    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319017    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319019    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319022    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319024    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319027    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319030    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.322673 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319134    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319146    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319154    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319158    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319163    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319168    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319176    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319181    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319185    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319188    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319192    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319195    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319198    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319201    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319204    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319207    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319210    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319213    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319217    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319220    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319223    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319226    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319229    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319232    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:30:04.323204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319235    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319238    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319242    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319245    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319247    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319250    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319253    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319256    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319261    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319265    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319269    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319271    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319274    2573 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319277    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319282    2573 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319285    2573 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319288    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319291    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319294    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319298    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319301    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319304    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319307    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319310    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319313    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:30:04.323763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319316    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319319    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319322    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319325    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319328    2573 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319331    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319334    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319337    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319340    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319343    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319346    2573 flags.go:64] FLAG: --help="false"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319349    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319352    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319355    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319358    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319362    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319368    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319371    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319374    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319377    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319380    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319383    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319386    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319389    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:30:04.324430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319392    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319395    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319398    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319401    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319403    2573 flags.go:64] FLAG: --lock-file=""
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319407    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319409    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319412    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319418    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319420    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319423    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319426    2573 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319429    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319432    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319435    2573 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319437    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319441    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319444    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319448    2573 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319451    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319454    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319457    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319460    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319463    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319466    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:30:04.325017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319469    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319477    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319480    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319483    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319486    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319489    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319494    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319496    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319499    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319502    2573 flags.go:64] FLAG: --port="10250"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319505    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319508    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0805c43e02a544185"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319511    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319514    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319516    2573 flags.go:64] FLAG: --register-node="true"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319519    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319523    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319526    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319529    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319531    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319535    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319538    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319541    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319543    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319546    2573 flags.go:64] FLAG: --runonce="false"
Jul 07 15:30:04.325639 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319549    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319551    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319554    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319557    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319560    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319563    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319569    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319572    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319575    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319586    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319589    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319592    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319595    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319598    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319601    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319607    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319610    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319613    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319617    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319619    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319622    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319625    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319628    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319631    2573 flags.go:64] FLAG: --v="2"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319639    2573 flags.go:64] FLAG: --version="false"
Jul 07 15:30:04.326254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319643    2573 flags.go:64] FLAG: --vmodule=""
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319647    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.319650    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319768    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319773    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319777    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319780    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319783    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319786    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319789    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319792    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319796    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319799    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319805    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319808    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319811    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319814    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319818    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319821    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319824    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.326867 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319826    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319829    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319832    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319834    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319837    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319839    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319842    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319844    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319847    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319849    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319852    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319854    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319856    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319859    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319861    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319864    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319867    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319869    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319871    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.327390 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319874    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319878    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319881    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319884    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319887    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319889    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319895    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319898    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319900    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319903    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319905    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319908    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319911    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319913    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319916    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319918    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319921    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319924    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319926    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.327880 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319929    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319931    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319934    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319936    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319939    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319942    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319944    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319947    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319949    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319952    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319954    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319957    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319959    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319962    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319964    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319966    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319969    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319971    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319974    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319979    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.328482 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319982    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319984    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319987    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319989    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319992    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319995    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.319997    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320000    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320002    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320005    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320008    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320010    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320013    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320015    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320018    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320020    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320023    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320026    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320028    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320031    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.329370 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320033    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320036    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320038    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.320041    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.320828    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.328470    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:30:04.329976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.328496    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.329846    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.330002    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330100    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330107    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330111    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330115    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330118    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330121    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330123    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330126    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330129    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330133    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330137    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330140    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330143    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330146    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330148    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330151    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.330238 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330155    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330159    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330162    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330165    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330168    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330171    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330174    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330177    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330180    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330183    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330185    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330189    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330191    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330194    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330197    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330201    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330204    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330206    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330209    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330211    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.330707 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330214    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330217    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330219    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330222    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330224    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330227    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330229    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330231    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330234    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330236    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330239    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330242    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330244    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330247    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330250    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330252    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330255    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330258    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330260    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.331202 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330263    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330265    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330268    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330270    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330273    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330277    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330281    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330284    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330287    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330289    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330292    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330294    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330297    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330300    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330302    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330305    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330307    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330310    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330313    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.331661 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330315    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330318    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330320    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330323    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330325    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330327    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330330    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330333    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330336    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330338    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330341    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330343    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330346    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330348    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330351    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330353    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330356    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330359    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330361    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330363    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.332129 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330366    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330368    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330371    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330374    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330376    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.330381    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330500    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330505    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330508    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330511    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330514    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330517    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330520    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330523    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330526    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330528    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:30:04.332606 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330531    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330534    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330537    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330539    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330542    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330545    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330548    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330552    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330555    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330558    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330561    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330564    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330567    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330569    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330572    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330574    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330577    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330580    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330582    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:30:04.333013 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330585    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330588    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330590    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330593    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330595    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330598    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330600    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330603    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330605    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330608    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330610    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330613    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330615    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330618    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330620    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330623    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330627    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330630    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330632    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:30:04.333563 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330635    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330638    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330641    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330644    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330646    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330649    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330651    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330654    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330656    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330659    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330662    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330664    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330667    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330670    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330672    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330675    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330678    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330680    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330683    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330685    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:30:04.334004 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330687    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330690    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330692    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330695    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330697    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330700    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330702    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330705    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330708    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330711    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330714    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330717    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330719    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330722    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330724    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330727    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330730    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330732    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330734    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:30:04.334558 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330738    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330741    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330744    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330747    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330750    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330752    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330755    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330758    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330760    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330763    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330766    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:04.330768    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.330773    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.330888    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:30:04.335050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.334327    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:30:04.335885 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.335873    2573 server.go:1019] "Starting client certificate rotation"
Jul 07 15:30:04.336006 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.335986    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:30:04.336078 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.336040    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:30:04.339196 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.339180    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:30:04.340401 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.340380    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:30:04.347796 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.347780    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:30:04.349979 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.349962    2573 log.go:25] "Validated CRI v1 image API"
Jul 07 15:30:04.350838 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.350822    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:30:04.358154 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.358130    2573 fs.go:135] Filesystem UUIDs: map[128d918d-7a51-4d75-ae64-6aa8dbaad86d:/dev/nvme0n1p3 6a22f8c7-aee1-4c0b-9885-936aeb8e196e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 07 15:30:04.358214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.358154    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:30:04.364302 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.364191    2573 manager.go:216] Machine: {Timestamp:2026-07-07 15:30:04.362588819 +0000 UTC m=+0.386786081 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099477 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26266e4b9efd2addc6905e3ff39a36 SystemUUID:ec26266e-4b9e-fd2a-ddc6-905e3ff39a36 BootID:247bbe02-5f60-43ef-a3d9-13b30cacc2b0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:c4:9c:43:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:c4:9c:43:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:b0:40:4d:19:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:30:04.364302 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.364297    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:30:04.364410 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.364374    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:30:04.368186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.368154    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:30:04.368329 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.368191    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:30:04.369926 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.369899    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:30:04.369996 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.369935    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:30:04.369996 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.369948    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:30:04.370455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.370431    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:30:04.370733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.370704    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:30:04.372401 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.372384    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:30:04.375418 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375406    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:30:04.375542 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375532    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:30:04.375575 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375565    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:30:04.375606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375578    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:30:04.375606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375593    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:30:04.375606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375602    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:30:04.375687 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.375612    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:30:04.376035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.376022    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:30:04.376089 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.376042    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:30:04.378764 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.378745    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:30:04.380980 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.380967    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:30:04.381026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.380997    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:30:04.382397 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382386    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382403    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382410    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382417    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382427    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382433    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382441    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:30:04.382449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382446    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:30:04.382630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382454    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:30:04.382630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382459    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:30:04.382630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382468    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:30:04.382630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.382473    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:30:04.383327 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.383311    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:30:04.383327 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.383323    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:30:04.385528 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.385510    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:30:04.385606 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.385529    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:30:04.385606 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.385566    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:30:04.386572 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.386548    2573 server.go:1268] "Started kubelet"
Jul 07 15:30:04.386647 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.386616    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:30:04.387089 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.386741    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:30:04.387089 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.386804    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:30:04.387578 ip-10-0-132-109 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:30:04.387993 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.387976    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:30:04.388447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.388430    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:30:04.392236 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.391228    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-109.ec2.internal.18c00b990b51b0a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-109.ec2.internal,UID:ip-10-0-132-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-109.ec2.internal,},FirstTimestamp:2026-07-07 15:30:04.386521257 +0000 UTC m=+0.410718517,LastTimestamp:2026-07-07 15:30:04.386521257 +0000 UTC m=+0.410718517,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-109.ec2.internal,}"
Jul 07 15:30:04.392513 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.392497    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:30:04.395830 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.395814    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:30:04.395938 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.395832    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:30:04.395999 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.395931    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.396469 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396452    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:30:04.396573 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396543    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:30:04.396573 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396557    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:30:04.396698 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396676    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:30:04.396698 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396698    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:30:04.396928 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396906    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fjsrb"
Jul 07 15:30:04.397027 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.396994    2573 factory.go:153] Registering CRI-O factory
Jul 07 15:30:04.397027 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397006    2573 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:30:04.397166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397053    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:30:04.397166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397061    2573 factory.go:55] Registering systemd factory
Jul 07 15:30:04.397166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397085    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:30:04.397166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397105    2573 factory.go:103] Registering Raw factory
Jul 07 15:30:04.397166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397114    2573 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:30:04.397694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.397674    2573 manager.go:349] Starting recovery of all containers
Jul 07 15:30:04.398181 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.398157    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 15:30:04.398290 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.398192    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 15:30:04.406262 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.406034    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fjsrb"
Jul 07 15:30:04.410570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.410550    2573 manager.go:354] Recovery completed
Jul 07 15:30:04.414761 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.414748    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.416812 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.416793    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.416869 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.416827    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.416869 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.416838    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.417439 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.417421    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:30:04.417439 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.417438    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:30:04.417540 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.417445    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.417540 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.417455    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:30:04.418204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418188    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.418264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418214    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.418264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418225    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.418814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418800    2573 policy_none.go:49] "None policy: Start"
Jul 07 15:30:04.418814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418816    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:30:04.418907 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.418827    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:30:04.419946 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.419935    2573 policy_none.go:47] "Start"
Jul 07 15:30:04.464690 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.464664    2573 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:30:04.464786 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.464711    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:30:04.464786 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.464725    2573 server.go:87] "Starting device plugin registration server"
Jul 07 15:30:04.465012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.464999    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:30:04.465100 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.465013    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:30:04.465150 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.465104    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:30:04.465199 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.465189    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:30:04.465199 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.465197    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:30:04.465784 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.465764    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:30:04.465875 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.465814    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.565659 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.565571    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.566920 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.566573    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.566920 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.566608    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.566920 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.566619    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.566920 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.566652    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.573835 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.573818    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.573902 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.573844    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-109.ec2.internal\": node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.589973 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.589932    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:30:04.591315 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.591296    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:30:04.591412 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.591332    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:30:04.591412 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.591352    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:30:04.591412 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.591384    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:30:04.596866 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.596844    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.596966 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.596953    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:04.691755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.691716    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"]
Jul 07 15:30:04.691864 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.691799    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.693463 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.693446    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.693529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.693478    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.693529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.693488    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.694924 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.694909    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.695021 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.695082 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695035    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.695787 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695771    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.695879 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695804    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.695879 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695820    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.695879 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695772    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.695879 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695872    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.696060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.695887    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.697262 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.697246    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.697398 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.697384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.697439 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.697413    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:30:04.698090 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.698172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698090    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:30:04.698172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8f27341c4c149835f7420faa8e8961a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-109.ec2.internal\" (UID: \"d8f27341c4c149835f7420faa8e8961a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.698172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698115    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:30:04.698172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.698172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.698132    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:30:04.725917 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.725895    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-109.ec2.internal\" not found" node="ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.730297 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.730275    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-109.ec2.internal\" not found" node="ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.797440 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.797402    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.798526 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.798581 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8f27341c4c149835f7420faa8e8961a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-109.ec2.internal\" (UID: \"d8f27341c4c149835f7420faa8e8961a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.798581 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.798581 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.798682 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d063cf352c2c679e059c7e686b73a7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal\" (UID: \"9d063cf352c2c679e059c7e686b73a7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.798682 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:04.798617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8f27341c4c149835f7420faa8e8961a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-109.ec2.internal\" (UID: \"d8f27341c4c149835f7420faa8e8961a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:04.898014 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.897929    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:04.998433 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:04.998405    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.029697 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.029660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:05.037513 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.037492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:05.098995 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.098929    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.199526 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.199438    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.238401 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.238377    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:05.300154 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.300128    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.335378 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.335350    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:30:05.335887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.335499    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:30:05.335887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.335516    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:30:05.401016 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.400983    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.408655 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.408622    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:25:04 +0000 UTC" deadline="2028-01-20 00:11:44.894855993 +0000 UTC"
Jul 07 15:30:05.408655 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.408650    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13472h41m39.486210802s"
Jul 07 15:30:05.501146 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.501052    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.602215 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.602186    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.648163 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.648116    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:05.702863 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:05.702831    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-109.ec2.internal\" not found"
Jul 07 15:30:05.742788 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.742762    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:05.799118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.799022    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:05.815020 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.814994    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:30:05.816143 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.816130    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal"
Jul 07 15:30:05.826745 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:05.826724    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:30:06.017623 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.017580    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f27341c4c149835f7420faa8e8961a.slice/crio-50e0e21d5a6a8381971810030dcd8bd26de7576304b1e7329c047b4e29e813bb WatchSource:0}: Error finding container 50e0e21d5a6a8381971810030dcd8bd26de7576304b1e7329c047b4e29e813bb: Status 404 returned error can't find the container with id 50e0e21d5a6a8381971810030dcd8bd26de7576304b1e7329c047b4e29e813bb
Jul 07 15:30:06.022701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.022685    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:30:06.377500 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.377472    2573 apiserver.go:52] "Watching apiserver"
Jul 07 15:30:06.385062 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.385035    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:30:06.385421 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.385397    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal","openshift-network-diagnostics/network-check-target-jlgcw","openshift-network-operator/iptables-alerter-qdsl2","openshift-ovn-kubernetes/ovnkube-node-hg4wb","kube-system/konnectivity-agent-84nxm","kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w","openshift-cluster-node-tuning-operator/tuned-jrvqw","openshift-dns/node-resolver-xt7lq","openshift-multus/multus-additional-cni-plugins-f8twb","openshift-multus/multus-gcfrd","openshift-multus/network-metrics-daemon-f2f5c","kube-system/global-pull-secret-syncer-8gfbn","openshift-image-registry/node-ca-r8vpk"]
Jul 07 15:30:06.388023 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.388003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.389438 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.389420    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.390895 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.390877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.392554 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.392533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.394275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.394258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.395946 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.395925    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:30:06.396044 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.395925    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.396850 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.396829    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.396850 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.396847    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.397001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.396835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:30:06.397001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.396835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:30:06.397464 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.397448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.397740 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.397720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:30:06.397978 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.397964    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrjbk\""
Jul 07 15:30:06.398028 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.397990    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:30:06.398295 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398276    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.398400 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398381    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.398400 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:30:06.398488 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398467    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.398600 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zm7f5\""
Jul 07 15:30:06.398654 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.398625    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:30:06.399417 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.399402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.401274 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.401218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.401368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.401280    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgg4v\""
Jul 07 15:30:06.401659 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.401638    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.401736 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.401708    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dlzbq\""
Jul 07 15:30:06.401875 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.401858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.402110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.402097    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.402757 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.402736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4tgxt\""
Jul 07 15:30:06.402861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.402807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.402923 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.402881    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:30:06.402987 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.402970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.403064 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.403041    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:06.404520 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.404499    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.404605 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.404558    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:06.406026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.405909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35102d5-b6ee-403d-9412-2b0a9b317468-tmp-dir\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.406026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.405947    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.405944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-systemd\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-netns\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-node-log\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-socket-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.406847    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-device-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cnibin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406916    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.406953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-etc-selinux\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.407159    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.407173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cni-binary-copy\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.407631    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.407661    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.407963    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:30:06.408426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-systemd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ng8dd\""
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408388    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-bin\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-kubelet\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-env-overrides\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-script-lib\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9gj\" (UniqueName: \"kubernetes.io/projected/72fba4c7-62be-40ee-9c6a-567084dc9134-kube-api-access-kr9gj\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408760    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65803f05-64dc-47f2-a0f5-1087a948de3a-serviceca\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408839    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kfq27\""
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-systemd-units\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-sys\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.408993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-slash\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-netd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409120    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-agent-certs\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-modprobe-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.409481 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-registration-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-kubelet\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-konnectivity-ca\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f92x5\""
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysconfig\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-tmp\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409333    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5trmm\""
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-sys-fs\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-netns\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.409973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d35102d5-b6ee-403d-9412-2b0a9b317468-hosts-file\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-socket-dir-parent\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5fj4\" (UniqueName: \"kubernetes.io/projected/4039bdc1-b377-47c8-bcc3-fb61ace25c28-kube-api-access-q5fj4\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94hz\" (UniqueName: \"kubernetes.io/projected/d35102d5-b6ee-403d-9412-2b0a9b317468-kube-api-access-w94hz\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-bin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-conf-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrc9\" (UniqueName: \"kubernetes.io/projected/65803f05-64dc-47f2-a0f5-1087a948de3a-kube-api-access-xqrc9\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410466    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:06.410495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-etc-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovn-node-metrics-cert\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-lib-modules\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-k8s-cni-cncf-io\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-system-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-os-release\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-daemon-config\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-etc-kubernetes\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnxt9\" (UniqueName: \"kubernetes.io/projected/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-kube-api-access-xnxt9\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.410956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-config\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-log-socket\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-run\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-conf\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-var-lib-kubelet\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-host\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-hostroot\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-multus-certs\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-ovn\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-multus\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-kubernetes\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxcw\" (UniqueName: \"kubernetes.io/projected/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-kube-api-access-snxcw\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-var-lib-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65803f05-64dc-47f2-a0f5-1087a948de3a-host\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.411964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.411813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-tuned\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.422690 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.422671    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:30:06.496689 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.496657    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4ggf"
Jul 07 15:30:06.497424 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.497403    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:30:06.513062 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513034    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4ggf"
Jul 07 15:30:06.513167 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-etc-selinux\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.513167 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:06.513167 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-os-release\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cni-binary-copy\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-systemd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513304    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-systemd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-etc-selinux\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-bin\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-bin\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-kubelet\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-env-overrides\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-script-lib\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9gj\" (UniqueName: \"kubernetes.io/projected/72fba4c7-62be-40ee-9c6a-567084dc9134-kube-api-access-kr9gj\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65803f05-64dc-47f2-a0f5-1087a948de3a-serviceca\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.513537 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-kubelet\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-systemd-units\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-sys\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-slash\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-netd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-agent-certs\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-modprobe-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-sys\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-registration-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c08107-8418-4405-a013-ad29c24bb9a1-iptables-alerter-script\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-kubelet\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513781    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-systemd-units\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-konnectivity-ca\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513832    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-cni-netd\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysconfig\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513778    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-slash\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-tmp\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513883    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-modprobe-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.514413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513883    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-kubelet\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513947    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-env-overrides\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513954    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-registration-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.513953    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysconfig\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-sys-fs\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514068    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514082    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65803f05-64dc-47f2-a0f5-1087a948de3a-serviceca\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-netns\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514136    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-sys-fs\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d35102d5-b6ee-403d-9412-2b0a9b317468-hosts-file\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-socket-dir-parent\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514177    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-netns\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5fj4\" (UniqueName: \"kubernetes.io/projected/4039bdc1-b377-47c8-bcc3-fb61ace25c28-kube-api-access-q5fj4\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514223    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d35102d5-b6ee-403d-9412-2b0a9b317468-hosts-file\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-kubelet-config\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514237    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:30:06.515368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514263    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-socket-dir-parent\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514317    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-script-lib\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94hz\" (UniqueName: \"kubernetes.io/projected/d35102d5-b6ee-403d-9412-2b0a9b317468-kube-api-access-w94hz\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-bin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-conf-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-bin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514527    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-konnectivity-ca\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrc9\" (UniqueName: \"kubernetes.io/projected/65803f05-64dc-47f2-a0f5-1087a948de3a-kube-api-access-xqrc9\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-etc-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514618    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-conf-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovn-node-metrics-cert\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-etc-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514746    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cni-binary-copy\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-lib-modules\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc6sp\" (UniqueName: \"kubernetes.io/projected/2af92310-b8b2-4d39-a30a-3d2b80cc2537-kube-api-access-wc6sp\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-k8s-cni-cncf-io\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.516287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-system-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-os-release\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-daemon-config\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-etc-kubernetes\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514926    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-k8s-cni-cncf-io\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnxt9\" (UniqueName: \"kubernetes.io/projected/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-kube-api-access-xnxt9\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514993    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-system-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-config\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-os-release\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.514945    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-lib-modules\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-log-socket\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-run\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-conf\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-etc-kubernetes\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-var-lib-kubelet\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-host\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515220    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-run\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517088 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7kt\" (UniqueName: \"kubernetes.io/projected/d4c08107-8418-4405-a013-ad29c24bb9a1-kube-api-access-nz7kt\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-log-socket\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-hostroot\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-multus-certs\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-ovn\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515406    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-conf\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-var-lib-kubelet\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515550    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-daemon-config\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-host\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515600    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-hostroot\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515642    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-run-multus-certs\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515636    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-run-ovn\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovnkube-config\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-multus\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515786    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-host-var-lib-cni-multus\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-kubernetes\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.517839 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxcw\" (UniqueName: \"kubernetes.io/projected/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-kube-api-access-snxcw\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-cnibin\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-var-lib-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515900    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-kubernetes\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65803f05-64dc-47f2-a0f5-1087a948de3a-host\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.515984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-var-lib-openvswitch\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-tuned\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c08107-8418-4405-a013-ad29c24bb9a1-host-slash\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-system-cni-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfjc\" (UniqueName: \"kubernetes.io/projected/cfd968ec-4e1c-465a-a03c-11655b86852d-kube-api-access-pmfjc\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516179    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65803f05-64dc-47f2-a0f5-1087a948de3a-host\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35102d5-b6ee-403d-9412-2b0a9b317468-tmp-dir\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-systemd\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516299    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-systemd\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-dbus\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.518608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-netns\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-node-log\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-socket-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-device-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cnibin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516710    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35102d5-b6ee-403d-9412-2b0a9b317468-tmp-dir\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-run-netns\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516764    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-sysctl-d\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-multus-cni-dir\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516823    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-node-log\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-device-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516885    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72fba4c7-62be-40ee-9c6a-567084dc9134-socket-dir\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516901    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-cnibin\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.516929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4039bdc1-b377-47c8-bcc3-fb61ace25c28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.518112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4039bdc1-b377-47c8-bcc3-fb61ace25c28-ovn-node-metrics-cert\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.518240    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c03398b-e577-4d2d-a6fc-ed22dbc34ba5-agent-certs\") pod \"konnectivity-agent-84nxm\" (UID: \"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5\") " pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.519230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.518272    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-tmp\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.519790 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.518473    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-etc-tuned\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.549409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.549375    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrc9\" (UniqueName: \"kubernetes.io/projected/65803f05-64dc-47f2-a0f5-1087a948de3a-kube-api-access-xqrc9\") pod \"node-ca-r8vpk\" (UID: \"65803f05-64dc-47f2-a0f5-1087a948de3a\") " pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.549575 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.549547    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnxt9\" (UniqueName: \"kubernetes.io/projected/1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4-kube-api-access-xnxt9\") pod \"multus-gcfrd\" (UID: \"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4\") " pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.549650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.549622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9gj\" (UniqueName: \"kubernetes.io/projected/72fba4c7-62be-40ee-9c6a-567084dc9134-kube-api-access-kr9gj\") pod \"aws-ebs-csi-driver-node-drc7w\" (UID: \"72fba4c7-62be-40ee-9c6a-567084dc9134\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.549718 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.549619    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5fj4\" (UniqueName: \"kubernetes.io/projected/4039bdc1-b377-47c8-bcc3-fb61ace25c28-kube-api-access-q5fj4\") pod \"ovnkube-node-hg4wb\" (UID: \"4039bdc1-b377-47c8-bcc3-fb61ace25c28\") " pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.550668 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.550639    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxcw\" (UniqueName: \"kubernetes.io/projected/5db19c6e-77fb-43e1-a753-3cb82d7eaf27-kube-api-access-snxcw\") pod \"tuned-jrvqw\" (UID: \"5db19c6e-77fb-43e1-a753-3cb82d7eaf27\") " pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.557328 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.557310    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94hz\" (UniqueName: \"kubernetes.io/projected/d35102d5-b6ee-403d-9412-2b0a9b317468-kube-api-access-w94hz\") pod \"node-resolver-xt7lq\" (UID: \"d35102d5-b6ee-403d-9412-2b0a9b317468\") " pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.597162 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.597103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal" event={"ID":"d8f27341c4c149835f7420faa8e8961a","Type":"ContainerStarted","Data":"50e0e21d5a6a8381971810030dcd8bd26de7576304b1e7329c047b4e29e813bb"}
Jul 07 15:30:06.606441 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.606418    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:06.617735 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c08107-8418-4405-a013-ad29c24bb9a1-host-slash\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.617814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.617814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-system-cni-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.617814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfjc\" (UniqueName: \"kubernetes.io/projected/cfd968ec-4e1c-465a-a03c-11655b86852d-kube-api-access-pmfjc\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.617917 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617864    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-system-cni-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.617917 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.617886    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:06.617982 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.617934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c08107-8418-4405-a013-ad29c24bb9a1-host-slash\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.618020 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.618015    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:07.117980062 +0000 UTC m=+3.142177328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:06.618065 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-dbus\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.618125 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:06.618183 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-os-release\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618183 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618183 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618204    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-dbus\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c08107-8418-4405-a013-ad29c24bb9a1-iptables-alerter-script\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618220    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-os-release\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-kubelet-config\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.618343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc6sp\" (UniqueName: \"kubernetes.io/projected/2af92310-b8b2-4d39-a30a-3d2b80cc2537-kube-api-access-wc6sp\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1d63266-f946-42f2-830c-9aa08621d127-kubelet-config\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7kt\" (UniqueName: \"kubernetes.io/projected/d4c08107-8418-4405-a013-ad29c24bb9a1-kube-api-access-nz7kt\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.618464    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.618545    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:07.118526658 +0000 UTC m=+3.142723912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.618675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-cnibin\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.619109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618680    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfd968ec-4e1c-465a-a03c-11655b86852d-cnibin\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.619109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.619109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.618968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c08107-8418-4405-a013-ad29c24bb9a1-iptables-alerter-script\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.619109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.619072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.619109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.619091    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd968ec-4e1c-465a-a03c-11655b86852d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.631051 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.630989    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:06.631051 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.631021    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:06.631051 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.631037    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:06.631270 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:06.631125    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:07.131104973 +0000 UTC m=+3.155302245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:06.634794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.634771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfjc\" (UniqueName: \"kubernetes.io/projected/cfd968ec-4e1c-465a-a03c-11655b86852d-kube-api-access-pmfjc\") pod \"multus-additional-cni-plugins-f8twb\" (UID: \"cfd968ec-4e1c-465a-a03c-11655b86852d\") " pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.635375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.635355    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc6sp\" (UniqueName: \"kubernetes.io/projected/2af92310-b8b2-4d39-a30a-3d2b80cc2537-kube-api-access-wc6sp\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:06.636552 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.636528    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7kt\" (UniqueName: \"kubernetes.io/projected/d4c08107-8418-4405-a013-ad29c24bb9a1-kube-api-access-nz7kt\") pod \"iptables-alerter-qdsl2\" (UID: \"d4c08107-8418-4405-a013-ad29c24bb9a1\") " pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.698746 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.698707    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcfrd"
Jul 07 15:30:06.704962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.704940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8vpk"
Jul 07 15:30:06.709126 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.709074    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fec9d6c_5c42_47e9_ae1e_43dbc450e4a4.slice/crio-7d4d582f14a1529d54e2f19bfa444795d792e374f5b780e0843e4f751916461b WatchSource:0}: Error finding container 7d4d582f14a1529d54e2f19bfa444795d792e374f5b780e0843e4f751916461b: Status 404 returned error can't find the container with id 7d4d582f14a1529d54e2f19bfa444795d792e374f5b780e0843e4f751916461b
Jul 07 15:30:06.714447 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.714418    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65803f05_64dc_47f2_a0f5_1087a948de3a.slice/crio-2ca9f0f1eb932a0b68eb4ea7adecfd4b19e40c3ae05072e184390248dea6ca98 WatchSource:0}: Error finding container 2ca9f0f1eb932a0b68eb4ea7adecfd4b19e40c3ae05072e184390248dea6ca98: Status 404 returned error can't find the container with id 2ca9f0f1eb932a0b68eb4ea7adecfd4b19e40c3ae05072e184390248dea6ca98
Jul 07 15:30:06.715373 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.715349    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w"
Jul 07 15:30:06.719300 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.719279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:06.725248 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.725226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:06.726184 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.726132    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fba4c7_62be_40ee_9c6a_567084dc9134.slice/crio-b6299bbc502efac493116ebad1d8159d8c5be6c17674beb49f233fb3229ff308 WatchSource:0}: Error finding container b6299bbc502efac493116ebad1d8159d8c5be6c17674beb49f233fb3229ff308: Status 404 returned error can't find the container with id b6299bbc502efac493116ebad1d8159d8c5be6c17674beb49f233fb3229ff308
Jul 07 15:30:06.730962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.730938    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jrvqw"
Jul 07 15:30:06.731584 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.731545    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4039bdc1_b377_47c8_bcc3_fb61ace25c28.slice/crio-976044158fb7000bfafa0722be0f9eebe699c039f6c34317b715b5b910da8593 WatchSource:0}: Error finding container 976044158fb7000bfafa0722be0f9eebe699c039f6c34317b715b5b910da8593: Status 404 returned error can't find the container with id 976044158fb7000bfafa0722be0f9eebe699c039f6c34317b715b5b910da8593
Jul 07 15:30:06.736219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.736160    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xt7lq"
Jul 07 15:30:06.742200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.741971    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8twb"
Jul 07 15:30:06.742658 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.742636    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db19c6e_77fb_43e1_a753_3cb82d7eaf27.slice/crio-65edb9fe4a293481f2e039e71823db3eb15f595c8ecc019341c61b7545a0957f WatchSource:0}: Error finding container 65edb9fe4a293481f2e039e71823db3eb15f595c8ecc019341c61b7545a0957f: Status 404 returned error can't find the container with id 65edb9fe4a293481f2e039e71823db3eb15f595c8ecc019341c61b7545a0957f
Jul 07 15:30:06.747805 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:06.747639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qdsl2"
Jul 07 15:30:06.747895 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.747802    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35102d5_b6ee_403d_9412_2b0a9b317468.slice/crio-02eb213a8502e78bd3c58ba4e5d752e567d6b0fce3ee456f2c5c293feafcf771 WatchSource:0}: Error finding container 02eb213a8502e78bd3c58ba4e5d752e567d6b0fce3ee456f2c5c293feafcf771: Status 404 returned error can't find the container with id 02eb213a8502e78bd3c58ba4e5d752e567d6b0fce3ee456f2c5c293feafcf771
Jul 07 15:30:06.757495 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.757472    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd968ec_4e1c_465a_a03c_11655b86852d.slice/crio-195d201f49c12575ec28e431dbca751940d264d5d5db503ea296de9d0a4f581e WatchSource:0}: Error finding container 195d201f49c12575ec28e431dbca751940d264d5d5db503ea296de9d0a4f581e: Status 404 returned error can't find the container with id 195d201f49c12575ec28e431dbca751940d264d5d5db503ea296de9d0a4f581e
Jul 07 15:30:06.762654 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.762239    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c08107_8418_4405_a013_ad29c24bb9a1.slice/crio-7bad42082861fca97d439287efcba29b34cf8bbdabdb2e6020d77745a89580af WatchSource:0}: Error finding container 7bad42082861fca97d439287efcba29b34cf8bbdabdb2e6020d77745a89580af: Status 404 returned error can't find the container with id 7bad42082861fca97d439287efcba29b34cf8bbdabdb2e6020d77745a89580af
Jul 07 15:30:06.953005 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:06.952974    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d063cf352c2c679e059c7e686b73a7c.slice/crio-ce1cdd1e2199eb1a652fb39875d9c1f83ff104046b5bab72f0ec73acb30736c5 WatchSource:0}: Error finding container ce1cdd1e2199eb1a652fb39875d9c1f83ff104046b5bab72f0ec73acb30736c5: Status 404 returned error can't find the container with id ce1cdd1e2199eb1a652fb39875d9c1f83ff104046b5bab72f0ec73acb30736c5
Jul 07 15:30:07.123469 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.123434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:07.123648 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.123531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:07.123734 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.123642    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:07.123734 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.123663    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:07.123734 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.123731    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:08.123709546 +0000 UTC m=+4.147906811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:07.123862 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.123754    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:08.123742452 +0000 UTC m=+4.147939709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:07.224625 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.224531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:07.225266 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.225220    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:07.225388 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.225279    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:07.225388 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.225298    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:07.225499 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.225388    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:08.225362716 +0000 UTC m=+4.249559966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:07.516831 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.516703    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:25:06 +0000 UTC" deadline="2028-01-14 05:30:13.711873049 +0000 UTC"
Jul 07 15:30:07.516831 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.516778    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13334h0m6.195099704s"
Jul 07 15:30:07.592191 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.592153    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:07.592381 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.592295    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:07.592755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.592733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:07.592861 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:07.592840    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:07.609891 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.609851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal" event={"ID":"9d063cf352c2c679e059c7e686b73a7c","Type":"ContainerStarted","Data":"ce1cdd1e2199eb1a652fb39875d9c1f83ff104046b5bab72f0ec73acb30736c5"}
Jul 07 15:30:07.615326 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.615293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qdsl2" event={"ID":"d4c08107-8418-4405-a013-ad29c24bb9a1","Type":"ContainerStarted","Data":"7bad42082861fca97d439287efcba29b34cf8bbdabdb2e6020d77745a89580af"}
Jul 07 15:30:07.617283 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.617250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xt7lq" event={"ID":"d35102d5-b6ee-403d-9412-2b0a9b317468","Type":"ContainerStarted","Data":"02eb213a8502e78bd3c58ba4e5d752e567d6b0fce3ee456f2c5c293feafcf771"}
Jul 07 15:30:07.619708 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.619631    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84nxm" event={"ID":"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5","Type":"ContainerStarted","Data":"1d9408f09a8bda32244802222051e3fe8ee4fecdaaabc6c1512d5eb942d6ebbe"}
Jul 07 15:30:07.624903 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.624875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcfrd" event={"ID":"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4","Type":"ContainerStarted","Data":"7d4d582f14a1529d54e2f19bfa444795d792e374f5b780e0843e4f751916461b"}
Jul 07 15:30:07.628003 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.627977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerStarted","Data":"195d201f49c12575ec28e431dbca751940d264d5d5db503ea296de9d0a4f581e"}
Jul 07 15:30:07.629924 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.629899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jrvqw" event={"ID":"5db19c6e-77fb-43e1-a753-3cb82d7eaf27","Type":"ContainerStarted","Data":"65edb9fe4a293481f2e039e71823db3eb15f595c8ecc019341c61b7545a0957f"}
Jul 07 15:30:07.632033 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.631995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"976044158fb7000bfafa0722be0f9eebe699c039f6c34317b715b5b910da8593"}
Jul 07 15:30:07.634691 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.634634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w" event={"ID":"72fba4c7-62be-40ee-9c6a-567084dc9134","Type":"ContainerStarted","Data":"b6299bbc502efac493116ebad1d8159d8c5be6c17674beb49f233fb3229ff308"}
Jul 07 15:30:07.640107 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:07.640061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8vpk" event={"ID":"65803f05-64dc-47f2-a0f5-1087a948de3a","Type":"ContainerStarted","Data":"2ca9f0f1eb932a0b68eb4ea7adecfd4b19e40c3ae05072e184390248dea6ca98"}
Jul 07 15:30:08.135132 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.135071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:08.135347 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.135192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:08.135414 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.135351    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:08.135473 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.135420    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:10.135399836 +0000 UTC m=+6.159597092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:08.135900 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.135877    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:08.136006 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.135940    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:10.13592249 +0000 UTC m=+6.160119747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:08.171941 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.171911    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:30:08.236445 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.236405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:08.236625 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.236580    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:08.236625 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.236601    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:08.236625 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.236614    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:08.236800 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.236678    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:10.236659205 +0000 UTC m=+6.260856455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:08.517759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.517642    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:25:06 +0000 UTC" deadline="2027-12-22 16:35:02.35299523 +0000 UTC"
Jul 07 15:30:08.517759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.517683    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12793h4m53.835317293s"
Jul 07 15:30:08.592741 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:08.592712    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:08.592912 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:08.592865    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:09.593394 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:09.593357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:09.593871 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:09.593491    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:09.593936 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:09.593874    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:09.593992 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:09.593966    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:10.158708 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:10.158667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:10.158911 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:10.158763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:10.158911 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.158896    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:10.159024 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.158965    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:14.158946207 +0000 UTC m=+10.183143462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:10.159402 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.159376    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:10.159529 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.159430    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:14.159415325 +0000 UTC m=+10.183612575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:10.259554 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:10.259503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:10.259781 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.259762    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:10.259864 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.259788    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:10.259864 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.259802    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:10.259864 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.259864    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:14.259846283 +0000 UTC m=+10.284043548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:10.592240 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:10.592159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:10.592404 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:10.592312    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:11.592339 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:11.592306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:11.592778 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:11.592441    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:11.592844 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:11.592833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:11.593019 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:11.592928    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:12.595470 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:12.595195    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:12.595905 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:12.595534    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:13.592267 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:13.592229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:13.592267 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:13.592259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:13.592519 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:13.592379    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:13.592836 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:13.592797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:14.192192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:14.192158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:14.192650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:14.192221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:14.192650 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.192332    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:14.192650 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.192366    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:14.192650 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.192391    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:22.192375772 +0000 UTC m=+18.216573021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:14.192650 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.192417    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:22.19240115 +0000 UTC m=+18.216598402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:14.292962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:14.292924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:14.293169 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.293145    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:14.293169 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.293167    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:14.293278 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.293176    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:14.293278 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.293231    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:22.293215807 +0000 UTC m=+18.317413072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:14.592624 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:14.592530    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:14.592784 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:14.592644    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:15.592212 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:15.592132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:15.592212 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:15.592152    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:15.592704 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:15.592269    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:15.592704 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:15.592412    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:16.594056 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:16.594023    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:16.594494 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:16.594191    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:17.591969 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:17.591934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:17.592154 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:17.591976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:17.592154 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:17.592086    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:17.592279 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:17.592196    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:18.592014 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:18.591985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:18.592473 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:18.592126    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:19.591872 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:19.591837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:19.592035 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:19.591964    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:19.592035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:19.592002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:19.592446 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:19.592107    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:20.591790 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:20.591754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:20.591949 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:20.591902    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:21.591595 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:21.591560    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:21.592054 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:21.591561    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:21.592054 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:21.591680    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:21.592054 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:21.591780    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:22.255017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:22.254981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:22.255310 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:22.255048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:22.255310 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.255172    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:22.255310 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.255231    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:38.255215631 +0000 UTC m=+34.279412883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:22.255492 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.255172    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:22.255568 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.255519    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:38.255505714 +0000 UTC m=+34.279702962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:22.356465 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:22.356425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:22.356638 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.356583    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:22.356638 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.356602    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:22.356638 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.356614    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:22.356767 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.356669    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:38.356653916 +0000 UTC m=+34.380851180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:22.592226 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:22.592148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:22.592675 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:22.592293    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:23.592372 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:23.592332    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:23.592372 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:23.592379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:23.592833 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:23.592468    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:23.592833 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:23.592594    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:24.592649 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:24.592611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:24.593132 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:24.592731    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:25.592404 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:25.592371    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:25.592594 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:25.592493    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:25.592594 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:25.592564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:25.592685 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:25.592651    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:26.591846 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:26.591811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:26.592120 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:26.591940    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:27.592026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.591882    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:27.592409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.591951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:27.592409 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:27.592164    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:27.592409 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:27.592235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:27.695472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.695449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jrvqw" event={"ID":"5db19c6e-77fb-43e1-a753-3cb82d7eaf27","Type":"ContainerStarted","Data":"4f1b2387bf81c3df0f6a03a731a119c75e5575e9bb16052751cffbdb44caca07"}
Jul 07 15:30:27.699778 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.699761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:30:27.700846 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.700822    2573 generic.go:356] "Generic (PLEG): container finished" podID="4039bdc1-b377-47c8-bcc3-fb61ace25c28" containerID="b5147b22f7cc886541dc11db0af16bc7af81ed6a944f2844e7ed6ccd72a125ea" exitCode=1
Jul 07 15:30:27.700937 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.700885    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"138d2ee3508e1cf3ed3586a5c5ecbaa71c1c45ec8f6589830978569f2ae6ad6a"}
Jul 07 15:30:27.700995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.700948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"5807f7c830d3600408d45095a20d7cb3aa67de2f67571f2dd42ca0d7494728b6"}
Jul 07 15:30:27.701039 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.700990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"a4f6e07caf1e8baea694af88a640f8a5b3b0f23c88d553c5bd6924a0ace007ed"}
Jul 07 15:30:27.701097 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.701040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerDied","Data":"b5147b22f7cc886541dc11db0af16bc7af81ed6a944f2844e7ed6ccd72a125ea"}
Jul 07 15:30:27.701159 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.701118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"638d775fb916b7ca4e991fa4584a97f78936743b9195b1bd83216842593b1539"}
Jul 07 15:30:27.702218 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.702198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal" event={"ID":"d8f27341c4c149835f7420faa8e8961a","Type":"ContainerStarted","Data":"d5ed40d6b111b23f9956c70a2290c8d1f6a884ee84146777a2221f4ed3a71eeb"}
Jul 07 15:30:27.703528 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.703508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcfrd" event={"ID":"1fec9d6c-5c42-47e9-ae1e-43dbc450e4a4","Type":"ContainerStarted","Data":"37922cee1b0dda0a0c3b8054ab74d0e038ec3536627d22c3cfae3b81048130b1"}
Jul 07 15:30:27.739671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.739622    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-109.ec2.internal" podStartSLOduration=21.739600997 podStartE2EDuration="21.739600997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:27.739203933 +0000 UTC m=+23.763401202" watchObservedRunningTime="2026-07-07 15:30:27.739600997 +0000 UTC m=+23.763798269"
Jul 07 15:30:27.739782 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.739755    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jrvqw" podStartSLOduration=2.3898709670000002 podStartE2EDuration="22.739746139s" totalImagesPullingTime="20.349875172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:27.722282891 +0000 UTC m=+23.746480161" watchObservedRunningTime="2026-07-07 15:30:27.739746139 +0000 UTC m=+23.763943454"
Jul 07 15:30:27.763239 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:27.763184    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gcfrd" podStartSLOduration=3.324475386 podStartE2EDuration="23.763167885s" totalImagesPullingTime="20.438692499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:27.762666043 +0000 UTC m=+23.786863316" watchObservedRunningTime="2026-07-07 15:30:27.763167885 +0000 UTC m=+23.787365154"
Jul 07 15:30:28.591952 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.591805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:28.592156 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:28.592040    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:28.706740 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.706672    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="275137abd27adbe6a07612e38e85df5290ec9ee9e65f097f85b1ba4ea13fcddf" exitCode=0
Jul 07 15:30:28.706911 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.706747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"275137abd27adbe6a07612e38e85df5290ec9ee9e65f097f85b1ba4ea13fcddf"}
Jul 07 15:30:28.709629 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.709611    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:30:28.709991 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.709972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"1bed854b59dfd31653e6eb4b06a32003c319a46f7e4b7db1ebc3d45ed7a768d9"}
Jul 07 15:30:28.711418 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.711387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w" event={"ID":"72fba4c7-62be-40ee-9c6a-567084dc9134","Type":"ContainerStarted","Data":"2f91dbd5a09dc36cda00cd905f6432de830761f0905858a1d753f8279c3f5885"}
Jul 07 15:30:28.712826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.712806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8vpk" event={"ID":"65803f05-64dc-47f2-a0f5-1087a948de3a","Type":"ContainerStarted","Data":"8a19659a102373fa832c03252ea9c74c21dd35d41af265137f0e63b396a3300f"}
Jul 07 15:30:28.714275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.714253    2573 generic.go:356] "Generic (PLEG): container finished" podID="9d063cf352c2c679e059c7e686b73a7c" containerID="5de2bf17f75e18bb4f5995665138edafd056a13ec97b7295ddb8a0c2cdde17e4" exitCode=0
Jul 07 15:30:28.714363 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.714318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal" event={"ID":"9d063cf352c2c679e059c7e686b73a7c","Type":"ContainerDied","Data":"5de2bf17f75e18bb4f5995665138edafd056a13ec97b7295ddb8a0c2cdde17e4"}
Jul 07 15:30:28.715690 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.715671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qdsl2" event={"ID":"d4c08107-8418-4405-a013-ad29c24bb9a1","Type":"ContainerStarted","Data":"970f991377afdd28d349dda5a9f9e6f0a3ba46f6ae843755753795133d8de834"}
Jul 07 15:30:28.716984 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.716957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xt7lq" event={"ID":"d35102d5-b6ee-403d-9412-2b0a9b317468","Type":"ContainerStarted","Data":"8c52790428bcf4d03b6615e8c4c391d95c79173d125e8a837b9b957bda885959"}
Jul 07 15:30:28.718195 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.718175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84nxm" event={"ID":"8c03398b-e577-4d2d-a6fc-ed22dbc34ba5","Type":"ContainerStarted","Data":"b49126c40b183e4e86d58b4be2cba95c57bcbc0c4ac32a233a20e06d27bf8ef7"}
Jul 07 15:30:28.767549 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.767504    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xt7lq" podStartSLOduration=7.7826891830000005 podStartE2EDuration="23.767486049s" totalImagesPullingTime="15.984796866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:28.750704887 +0000 UTC m=+24.774902156" watchObservedRunningTime="2026-07-07 15:30:28.767486049 +0000 UTC m=+24.791683320"
Jul 07 15:30:28.785545 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.785492    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qdsl2" podStartSLOduration=3.4544494070000002 podStartE2EDuration="23.785476308s" totalImagesPullingTime="20.331026901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:28.785434429 +0000 UTC m=+24.809631700" watchObservedRunningTime="2026-07-07 15:30:28.785476308 +0000 UTC m=+24.809673583"
Jul 07 15:30:28.786180 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.786141    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r8vpk" podStartSLOduration=4.407937656 podStartE2EDuration="24.786131382s" totalImagesPullingTime="20.378193726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:28.767240332 +0000 UTC m=+24.791437603" watchObservedRunningTime="2026-07-07 15:30:28.786131382 +0000 UTC m=+24.810328652"
Jul 07 15:30:28.830855 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.830811    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-84nxm" podStartSLOduration=7.834685855 podStartE2EDuration="23.830796276s" totalImagesPullingTime="15.996110421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:28.830390524 +0000 UTC m=+24.854587794" watchObservedRunningTime="2026-07-07 15:30:28.830796276 +0000 UTC m=+24.854993545"
Jul 07 15:30:28.887188 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.887157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:28.946171 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:28.946141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:29.250542 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.250485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:29.324762 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.324717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:29.592347 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.592282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:29.592812 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.592282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:29.592812 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:29.592402    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:29.592812 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:29.592445    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:29.721883 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.721851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal" event={"ID":"9d063cf352c2c679e059c7e686b73a7c","Type":"ContainerStarted","Data":"4ae5403b9929a498e2ae9c3692e38bb0d9b197cd61f7a7596579dfec45c0a3f3"}
Jul 07 15:30:29.743021 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.742984    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-109.ec2.internal" podStartSLOduration=23.742968302 podStartE2EDuration="23.742968302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:29.742874266 +0000 UTC m=+25.767071533" watchObservedRunningTime="2026-07-07 15:30:29.742968302 +0000 UTC m=+25.767165574"
Jul 07 15:30:29.746160 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:29.746125    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:30:30.477660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.477560    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:30:29.746151063Z","UUID":"4ce84aba-eed5-4ffb-b22c-cecbb1892ea5","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:30:30.479178 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.479131    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:30:30.479178 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.479179    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:30:30.592219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.592185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:30.592403 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:30.592339    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:30.727334 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.727310    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:30:30.727671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.727649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"f89de178b30f58120e03753100cba6f097877f1234d230af22ff0bb11a4c4b9b"}
Jul 07 15:30:30.729420 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.729360    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w" event={"ID":"72fba4c7-62be-40ee-9c6a-567084dc9134","Type":"ContainerStarted","Data":"0630e6f2856420e60c576430d5b207523b8fdd23c5bb2c45c9441ddfa759b863"}
Jul 07 15:30:30.762563 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:30.762541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:31.350877 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.350848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:31.422872 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.422835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:31.496892 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.496745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:31.591620 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.591590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:31.591775 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.591590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:31.591775 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:31.591689    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:31.591775 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:31.591757    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:31.734520 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.734490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w" event={"ID":"72fba4c7-62be-40ee-9c6a-567084dc9134","Type":"ContainerStarted","Data":"a6dacff7db2c89b42e894345937928ad6820117a7e017c3f13b13b7f5615aff3"}
Jul 07 15:30:31.757870 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:31.757816    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drc7w" podStartSLOduration=11.286011059 podStartE2EDuration="26.757796681s" totalImagesPullingTime="15.471785622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:31.756855131 +0000 UTC m=+27.781052401" watchObservedRunningTime="2026-07-07 15:30:31.757796681 +0000 UTC m=+27.781993952"
Jul 07 15:30:32.592565 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:32.592509    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:32.592717 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:32.592649    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:32.741096 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:32.741049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:30:32.741833 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:32.741603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"4e2ad2ee0c6c64877746de6221b8e2ae2c36b29b3167992f267bde3feff66264"}
Jul 07 15:30:32.742148 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:32.742131    2573 scope.go:117] "RemoveContainer" containerID="b5147b22f7cc886541dc11db0af16bc7af81ed6a944f2844e7ed6ccd72a125ea"
Jul 07 15:30:33.550269 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.550087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:33.550836 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.550814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:33.591893 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.591867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:33.592026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.591867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:33.592026 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:33.591995    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:33.592111 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:33.592032    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:33.748366 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.748341    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:30:33.748909 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.748769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" event={"ID":"4039bdc1-b377-47c8-bcc3-fb61ace25c28","Type":"ContainerStarted","Data":"058e31d844f19ea9f367b412ed57f5c29b455fb740b730b12ae5f12f830e68ca"}
Jul 07 15:30:33.749472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.749452    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:33.749631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.749519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:33.749631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.749551    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:33.750304 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.750279    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-84nxm"
Jul 07 15:30:33.768133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.768111    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:33.768947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.768928    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:30:33.784610 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.784563    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb" podStartSLOduration=8.351088991 podStartE2EDuration="28.784544679s" totalImagesPullingTime="20.433455688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:33.784027902 +0000 UTC m=+29.808225173" watchObservedRunningTime="2026-07-07 15:30:33.784544679 +0000 UTC m=+29.808741944"
Jul 07 15:30:33.855718 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:33.855645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:34.261026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.260984    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gfbn"]
Jul 07 15:30:34.261212 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.261172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:34.261278 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:34.261259    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:34.264895 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.264854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jlgcw"]
Jul 07 15:30:34.265048 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.264962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:34.265048 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:34.265040    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:34.265375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.265356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f2f5c"]
Jul 07 15:30:34.265461 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:34.265447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:34.265550 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:34.265529    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:35.592559 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:35.592516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:35.593014 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:35.592653    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:36.592271 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:36.592234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:36.592435 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:36.592234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:36.592435 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:36.592365    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:36.592546 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:36.592467    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:37.592560 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:37.592400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:37.592991 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:37.592631    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:37.759328 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:37.759294    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="e5b1746bd44d185c6f4925896625b1aabbac605362975e2600f44f430c3bbf42" exitCode=0
Jul 07 15:30:37.759458 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:37.759346    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"e5b1746bd44d185c6f4925896625b1aabbac605362975e2600f44f430c3bbf42"}
Jul 07 15:30:38.273205 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.273171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:38.273363 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.273240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:38.273363 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.273336    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:38.273363 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.273352    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:38.273523 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.273414    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs podName:2af92310-b8b2-4d39-a30a-3d2b80cc2537 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:10.273393539 +0000 UTC m=+66.297590807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs") pod "network-metrics-daemon-f2f5c" (UID: "2af92310-b8b2-4d39-a30a-3d2b80cc2537") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:38.273523 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.273433    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret podName:c1d63266-f946-42f2-830c-9aa08621d127 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:10.273423753 +0000 UTC m=+66.297621006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret") pod "global-pull-secret-syncer-8gfbn" (UID: "c1d63266-f946-42f2-830c-9aa08621d127") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:38.374497 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.374461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:38.374636 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.374595    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:38.374636 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.374613    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:38.374636 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.374625    2573 projected.go:196] Error preparing data for projected volume kube-api-access-cs657 for pod openshift-network-diagnostics/network-check-target-jlgcw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:38.374800 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.374680    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657 podName:d0402b9e-101a-4466-bb46-b4db4ae74042 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:10.374666835 +0000 UTC m=+66.398864083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs657" (UniqueName: "kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657") pod "network-check-target-jlgcw" (UID: "d0402b9e-101a-4466-bb46-b4db4ae74042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:38.591570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.591544    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:38.591672 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.591551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:38.591808 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.591676    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlgcw" podUID="d0402b9e-101a-4466-bb46-b4db4ae74042"
Jul 07 15:30:38.591808 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:38.591756    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2f5c" podUID="2af92310-b8b2-4d39-a30a-3d2b80cc2537"
Jul 07 15:30:38.763184 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.763153    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="7ae2ee5340814a2401624f39fe22ff6c3b6b51f2ef86164972d56b95ada458c9" exitCode=0
Jul 07 15:30:38.763538 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:38.763218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"7ae2ee5340814a2401624f39fe22ff6c3b6b51f2ef86164972d56b95ada458c9"}
Jul 07 15:30:39.591701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.591673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:39.591872 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:39.591777    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8gfbn" podUID="c1d63266-f946-42f2-830c-9aa08621d127"
Jul 07 15:30:39.775221 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.775195    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-109.ec2.internal" event="NodeReady"
Jul 07 15:30:39.775554 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.775326    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:30:39.831669 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.831641    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jd5qn"]
Jul 07 15:30:39.833746 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.833722    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:39.834988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.834968    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fjlr2"]
Jul 07 15:30:39.836186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.836158    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:30:39.836186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.836176    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:30:39.836324 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.836177    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\""
Jul 07 15:30:39.836930 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.836913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:39.839825 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.839804    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsljb\""
Jul 07 15:30:39.839918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.839834    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:30:39.839918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.839841    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:30:39.839918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.839869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:30:39.849529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.849507    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd5qn"]
Jul 07 15:30:39.850733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.850715    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fjlr2"]
Jul 07 15:30:39.920497 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.920455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.981159 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.981082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:39.987096 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cck7l\" (UniqueName: \"kubernetes.io/projected/7c4202c0-44f7-4c01-be06-c624e8b2ad06-kube-api-access-cck7l\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:39.987219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:39.987219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4202c0-44f7-4c01-be06-c624e8b2ad06-cert\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:39.987219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c75795-2322-445f-9d4f-6b824fffd84a-tmp-dir\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:39.987350 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c75795-2322-445f-9d4f-6b824fffd84a-config-volume\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:39.987350 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:39.987292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmq4\" (UniqueName: \"kubernetes.io/projected/41c75795-2322-445f-9d4f-6b824fffd84a-kube-api-access-6hmq4\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4202c0-44f7-4c01-be06-c624e8b2ad06-cert\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:40.088567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c75795-2322-445f-9d4f-6b824fffd84a-tmp-dir\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088655 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c75795-2322-445f-9d4f-6b824fffd84a-config-volume\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088738 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmq4\" (UniqueName: \"kubernetes.io/projected/41c75795-2322-445f-9d4f-6b824fffd84a-kube-api-access-6hmq4\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088789 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c75795-2322-445f-9d4f-6b824fffd84a-tmp-dir\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088789 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cck7l\" (UniqueName: \"kubernetes.io/projected/7c4202c0-44f7-4c01-be06-c624e8b2ad06-kube-api-access-cck7l\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:40.088877 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.088802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.088928 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:40.088896    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:40.088968 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:40.088963    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:30:40.588947736 +0000 UTC m=+36.613144984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:40.089236 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.089218    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c75795-2322-445f-9d4f-6b824fffd84a-config-volume\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.092671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.092650    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4202c0-44f7-4c01-be06-c624e8b2ad06-cert\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:40.098419 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.098375    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmq4\" (UniqueName: \"kubernetes.io/projected/41c75795-2322-445f-9d4f-6b824fffd84a-kube-api-access-6hmq4\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.101411 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.101382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cck7l\" (UniqueName: \"kubernetes.io/projected/7c4202c0-44f7-4c01-be06-c624e8b2ad06-kube-api-access-cck7l\") pod \"ingress-canary-fjlr2\" (UID: \"7c4202c0-44f7-4c01-be06-c624e8b2ad06\") " pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:40.147768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.147721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fjlr2"
Jul 07 15:30:40.301516 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.301477    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fjlr2"]
Jul 07 15:30:40.305512 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:40.305485    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4202c0_44f7_4c01_be06_c624e8b2ad06.slice/crio-b01530647c2eb777d44c0f03e9f49f05f024269ec013b31ad68b531598675f75 WatchSource:0}: Error finding container b01530647c2eb777d44c0f03e9f49f05f024269ec013b31ad68b531598675f75: Status 404 returned error can't find the container with id b01530647c2eb777d44c0f03e9f49f05f024269ec013b31ad68b531598675f75
Jul 07 15:30:40.591830 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.591799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:30:40.592010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.591991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:30:40.593202 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.593177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:40.593326 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:40.593312    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:40.593389 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:40.593379    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:30:41.593362394 +0000 UTC m=+37.617559643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:40.597320 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.597297    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:30:40.597453 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.597324    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:30:40.598314 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.598294    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\""
Jul 07 15:30:40.598413 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.598349    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\""
Jul 07 15:30:40.598455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.598415    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:30:40.769645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.769609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fjlr2" event={"ID":"7c4202c0-44f7-4c01-be06-c624e8b2ad06","Type":"ContainerStarted","Data":"b01530647c2eb777d44c0f03e9f49f05f024269ec013b31ad68b531598675f75"}
Jul 07 15:30:40.772045 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.772019    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="2dc44989340bcff97c1c4143f33559e5083cadf041813e549dd7afcaff5d2095" exitCode=0
Jul 07 15:30:40.772170 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:40.772077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"2dc44989340bcff97c1c4143f33559e5083cadf041813e549dd7afcaff5d2095"}
Jul 07 15:30:41.592204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:41.592174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:30:41.595374 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:41.595355    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:30:41.599829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:41.599801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:41.600003 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:41.599984    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:41.600088 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:41.600079    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:30:43.60004266 +0000 UTC m=+39.624239939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:43.614606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:43.614578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:43.614884 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:43.614722    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:43.614884 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:43.614784    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:30:47.614768772 +0000 UTC m=+43.638966021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:43.781713 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:43.781671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fjlr2" event={"ID":"7c4202c0-44f7-4c01-be06-c624e8b2ad06","Type":"ContainerStarted","Data":"c35ea7dc774dcd7a7b8cba1d654e90f1bb7fde6df189cacd4152e645122efc7b"}
Jul 07 15:30:43.802547 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:43.802492    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fjlr2" podStartSLOduration=1.54927304 podStartE2EDuration="4.802476237s" totalImagesPullingTime="3.253203197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:43.801734418 +0000 UTC m=+39.825931687" watchObservedRunningTime="2026-07-07 15:30:43.802476237 +0000 UTC m=+39.826673544"
Jul 07 15:30:44.438002 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.437960    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"]
Jul 07 15:30:44.461316 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.461282    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"]
Jul 07 15:30:44.461479 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.461416    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.465676 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.465652    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 15:30:44.465838 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.465686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8zfd8\""
Jul 07 15:30:44.465905 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.465872    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.466001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.465980    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 15:30:44.466101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.466060    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.477444 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.477424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"]
Jul 07 15:30:44.477561 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.477451    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"]
Jul 07 15:30:44.477561 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.477534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.481290 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.481267    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 15:30:44.481290 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.481277    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.481440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.481333    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 15:30:44.481440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.481271    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.484515 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.483053    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bt68x\""
Jul 07 15:30:44.559624 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.559592    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"]
Jul 07 15:30:44.576544 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.576513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.582824 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.582697    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q7qf4\""
Jul 07 15:30:44.584133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.584084    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"]
Jul 07 15:30:44.586242 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.586222    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.586242 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.586231    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.586369 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.586226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 15:30:44.597525 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.597502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"]
Jul 07 15:30:44.597614 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.597531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"
Jul 07 15:30:44.600623 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.600601    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mr658\""
Jul 07 15:30:44.605768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.605744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"]
Jul 07 15:30:44.621441 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621418    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.621733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwvh\" (UniqueName: \"kubernetes.io/projected/9814154f-5e50-4cca-87bf-bf3da7956f17-kube-api-access-twwvh\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.621733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9814154f-5e50-4cca-87bf-bf3da7956f17-config\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.621733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csbh\" (UniqueName: \"kubernetes.io/projected/ac632044-97a4-4d4b-927a-9e178525ed1e-kube-api-access-7csbh\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.621733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac632044-97a4-4d4b-927a-9e178525ed1e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.621733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.621679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9814154f-5e50-4cca-87bf-bf3da7956f17-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.687989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.687957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:44.722983 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.722914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac632044-97a4-4d4b-927a-9e178525ed1e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.722983 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.722959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9814154f-5e50-4cca-87bf-bf3da7956f17-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.722983 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.722981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.722999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwvh\" (UniqueName: \"kubernetes.io/projected/9814154f-5e50-4cca-87bf-bf3da7956f17-kube-api-access-twwvh\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9814154f-5e50-4cca-87bf-bf3da7956f17-config\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dnpc\" (UniqueName: \"kubernetes.io/projected/56a6f420-2635-4fb1-8931-491508e1be2a-kube-api-access-8dnpc\") pod \"network-check-source-989f8b8dc-4kfh8\" (UID: \"56a6f420-2635-4fb1-8931-491508e1be2a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723104    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:44.723111    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qj6\" (UniqueName: \"kubernetes.io/projected/db707a51-4d17-4bd2-a9fa-71cb802aeef6-kube-api-access-b2qj6\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7csbh\" (UniqueName: \"kubernetes.io/projected/ac632044-97a4-4d4b-927a-9e178525ed1e-kube-api-access-7csbh\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.723264 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:44.723227    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.223205133 +0000 UTC m=+41.247402399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:44.723658 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9814154f-5e50-4cca-87bf-bf3da7956f17-config\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.723713 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.723696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac632044-97a4-4d4b-927a-9e178525ed1e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.726939 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.726825    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9814154f-5e50-4cca-87bf-bf3da7956f17-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.741314 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.741294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csbh\" (UniqueName: \"kubernetes.io/projected/ac632044-97a4-4d4b-927a-9e178525ed1e-kube-api-access-7csbh\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:44.742674 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.742654    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwvh\" (UniqueName: \"kubernetes.io/projected/9814154f-5e50-4cca-87bf-bf3da7956f17-kube-api-access-twwvh\") pod \"service-ca-operator-5d46d9ffd4-hg48z\" (UID: \"9814154f-5e50-4cca-87bf-bf3da7956f17\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.770308 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.770278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:44.787148 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.787131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"
Jul 07 15:30:44.824486 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.824462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dnpc\" (UniqueName: \"kubernetes.io/projected/56a6f420-2635-4fb1-8931-491508e1be2a-kube-api-access-8dnpc\") pod \"network-check-source-989f8b8dc-4kfh8\" (UID: \"56a6f420-2635-4fb1-8931-491508e1be2a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"
Jul 07 15:30:44.824612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.824505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.824612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.824544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qj6\" (UniqueName: \"kubernetes.io/projected/db707a51-4d17-4bd2-a9fa-71cb802aeef6-kube-api-access-b2qj6\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.824768 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:44.824644    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:30:44.824768 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:44.824732    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls podName:db707a51-4d17-4bd2-a9fa-71cb802aeef6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.324710793 +0000 UTC m=+41.348908045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29mtn" (UID: "db707a51-4d17-4bd2-a9fa-71cb802aeef6") : secret "samples-operator-tls" not found
Jul 07 15:30:44.835507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.835487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dnpc\" (UniqueName: \"kubernetes.io/projected/56a6f420-2635-4fb1-8931-491508e1be2a-kube-api-access-8dnpc\") pod \"network-check-source-989f8b8dc-4kfh8\" (UID: \"56a6f420-2635-4fb1-8931-491508e1be2a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"
Jul 07 15:30:44.835675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.835657    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qj6\" (UniqueName: \"kubernetes.io/projected/db707a51-4d17-4bd2-a9fa-71cb802aeef6-kube-api-access-b2qj6\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:44.907631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.907606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"
Jul 07 15:30:44.923694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.923669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:44.940817 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:44.940779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z"]
Jul 07 15:30:44.945745 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:44.945721    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9814154f_5e50_4cca_87bf_bf3da7956f17.slice/crio-9e2f746531bcfaaf2d0af4bc8fb2f059b5b8f71e21cd393f8ecbbe402ed9088c WatchSource:0}: Error finding container 9e2f746531bcfaaf2d0af4bc8fb2f059b5b8f71e21cd393f8ecbbe402ed9088c: Status 404 returned error can't find the container with id 9e2f746531bcfaaf2d0af4bc8fb2f059b5b8f71e21cd393f8ecbbe402ed9088c
Jul 07 15:30:45.023694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.023665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:45.078400 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.078369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8"]
Jul 07 15:30:45.081047 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:45.081024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a6f420_2635_4fb1_8931_491508e1be2a.slice/crio-f392be68509eb3572a1026e07a65f14bbc22e2bf2b8ed64a9e44836b21f7c088 WatchSource:0}: Error finding container f392be68509eb3572a1026e07a65f14bbc22e2bf2b8ed64a9e44836b21f7c088: Status 404 returned error can't find the container with id f392be68509eb3572a1026e07a65f14bbc22e2bf2b8ed64a9e44836b21f7c088
Jul 07 15:30:45.228078 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.228042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:45.228279 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:45.228207    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:45.228347 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:45.228286    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.228266058 +0000 UTC m=+42.252463312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:45.328913 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.328845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:45.329030 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:45.328949    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:30:45.329030 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:45.328998    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls podName:db707a51-4d17-4bd2-a9fa-71cb802aeef6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.328984241 +0000 UTC m=+42.353181488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29mtn" (UID: "db707a51-4d17-4bd2-a9fa-71cb802aeef6") : secret "samples-operator-tls" not found
Jul 07 15:30:45.787844 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.787802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z" event={"ID":"9814154f-5e50-4cca-87bf-bf3da7956f17","Type":"ContainerStarted","Data":"9e2f746531bcfaaf2d0af4bc8fb2f059b5b8f71e21cd393f8ecbbe402ed9088c"}
Jul 07 15:30:45.788901 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:45.788874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8" event={"ID":"56a6f420-2635-4fb1-8931-491508e1be2a","Type":"ContainerStarted","Data":"f392be68509eb3572a1026e07a65f14bbc22e2bf2b8ed64a9e44836b21f7c088"}
Jul 07 15:30:46.235387 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:46.235348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:46.235573 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:46.235522    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:46.235640 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:46.235609    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.235585712 +0000 UTC m=+44.259782976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:46.335740 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:46.335709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:46.335989 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:46.335969    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:30:46.336043 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:46.336036    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls podName:db707a51-4d17-4bd2-a9fa-71cb802aeef6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.336020364 +0000 UTC m=+44.360217615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29mtn" (UID: "db707a51-4d17-4bd2-a9fa-71cb802aeef6") : secret "samples-operator-tls" not found
Jul 07 15:30:47.212963 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:47.212924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:47.481874 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:47.481839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:47.581705 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:47.581670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:47.646145 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:47.646111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:47.646300 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:47.646261    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:47.646353 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:47.646343    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:30:55.646322146 +0000 UTC m=+51.670519399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:48.251371 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:48.251330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:48.251812 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:48.251516    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:48.251812 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:48.251598    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.251579794 +0000 UTC m=+48.275777047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:48.352744 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:48.352711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:48.352905 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:48.352881    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:30:48.352967 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:48.352956    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls podName:db707a51-4d17-4bd2-a9fa-71cb802aeef6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.352941293 +0000 UTC m=+48.377138541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29mtn" (UID: "db707a51-4d17-4bd2-a9fa-71cb802aeef6") : secret "samples-operator-tls" not found
Jul 07 15:30:48.668364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:48.668278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:48.755417 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:48.755377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:48.853736 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:48.853701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.557347 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.557317    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t2q77"]
Jul 07 15:30:49.575176 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.575150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.579889 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.579862    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:30:49.580031 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.579896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r642f\""
Jul 07 15:30:49.580164 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.580148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:30:49.580389 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.580374    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:30:49.580583 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.580561    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2q77"]
Jul 07 15:30:49.580690 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.580675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:30:49.658673 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.658642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.662928 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.662903    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"]
Jul 07 15:30:49.694811 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.694774    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"]
Jul 07 15:30:49.694963 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.694911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"
Jul 07 15:30:49.698421 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.698264    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:49.698421 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.698272    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 15:30:49.698421 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.698370    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x9w5t\""
Jul 07 15:30:49.763576 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.763542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.763754 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.763585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d086fd7-1764-4a45-ad07-9d142c5ea357-crio-socket\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.763754 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.763613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d086fd7-1764-4a45-ad07-9d142c5ea357-data-volume\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.763754 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.763679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.763754 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.763714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v44ks\" (UniqueName: \"kubernetes.io/projected/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-api-access-v44ks\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.857983 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.857895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.864981 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.864952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.864999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d086fd7-1764-4a45-ad07-9d142c5ea357-crio-socket\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d086fd7-1764-4a45-ad07-9d142c5ea357-data-volume\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865232 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:49.865152    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:49.865279 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:49.865232    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.365213788 +0000 UTC m=+46.389411043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:49.865279 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v44ks\" (UniqueName: \"kubernetes.io/projected/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-api-access-v44ks\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865321    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d086fd7-1764-4a45-ad07-9d142c5ea357-crio-socket\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865326    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d086fd7-1764-4a45-ad07-9d142c5ea357-data-volume\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.865375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.865353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczkq\" (UniqueName: \"kubernetes.io/projected/62063ce6-e339-4681-a2a2-b7e4e73db212-kube-api-access-vczkq\") pod \"migrator-d57d58cc9-hbnxz\" (UID: \"62063ce6-e339-4681-a2a2-b7e4e73db212\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"
Jul 07 15:30:49.865542 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:49.865390    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:49.865542 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:49.865449    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.365436921 +0000 UTC m=+46.389634182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:49.875429 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.875401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v44ks\" (UniqueName: \"kubernetes.io/projected/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-api-access-v44ks\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:49.958798 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.958761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:49.965707 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.965672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczkq\" (UniqueName: \"kubernetes.io/projected/62063ce6-e339-4681-a2a2-b7e4e73db212-kube-api-access-vczkq\") pod \"migrator-d57d58cc9-hbnxz\" (UID: \"62063ce6-e339-4681-a2a2-b7e4e73db212\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"
Jul 07 15:30:49.983673 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:49.983647    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczkq\" (UniqueName: \"kubernetes.io/projected/62063ce6-e339-4681-a2a2-b7e4e73db212-kube-api-access-vczkq\") pod \"migrator-d57d58cc9-hbnxz\" (UID: \"62063ce6-e339-4681-a2a2-b7e4e73db212\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"
Jul 07 15:30:50.004995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:50.004761    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"
Jul 07 15:30:50.370766 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:50.370728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:50.370948 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:50.370802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:50.370948 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:50.370861    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:50.370948 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:50.370873    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:50.370948 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:50.370924    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.370907363 +0000 UTC m=+47.395104612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:50.370948 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:50.370939    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.370931451 +0000 UTC m=+47.395128699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.174037 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.174008    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz"]
Jul 07 15:30:51.176904 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:51.176549    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62063ce6_e339_4681_a2a2_b7e4e73db212.slice/crio-9993039f619652def26daea105f6d4de34623f504585bfa2f1fc011d3ea2a2d0 WatchSource:0}: Error finding container 9993039f619652def26daea105f6d4de34623f504585bfa2f1fc011d3ea2a2d0: Status 404 returned error can't find the container with id 9993039f619652def26daea105f6d4de34623f504585bfa2f1fc011d3ea2a2d0
Jul 07 15:30:51.378662 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.378578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:51.378662 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.378653    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:51.378852 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:51.378736    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.378852 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:51.378759    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:51.378852 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:51.378809    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.378794362 +0000 UTC m=+49.402991609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.378852 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:51.378825    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.378818996 +0000 UTC m=+49.403016243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:51.752623 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.752595    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xt7lq_d35102d5-b6ee-403d-9412-2b0a9b317468/dns-node-resolver/0.log"
Jul 07 15:30:51.804439 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.804376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z" event={"ID":"9814154f-5e50-4cca-87bf-bf3da7956f17","Type":"ContainerStarted","Data":"4648ad165dcee31a7ab1b2135138018c7cba41a57febe5488e6514a0c7cdfc19"}
Jul 07 15:30:51.805641 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.805610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz" event={"ID":"62063ce6-e339-4681-a2a2-b7e4e73db212","Type":"ContainerStarted","Data":"9993039f619652def26daea105f6d4de34623f504585bfa2f1fc011d3ea2a2d0"}
Jul 07 15:30:51.807211 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.807191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8" event={"ID":"56a6f420-2635-4fb1-8931-491508e1be2a","Type":"ContainerStarted","Data":"4f7040410165f12b38c997086597c7f25a40bf15b8dc9c2a0f90d8f2b6cf133c"}
Jul 07 15:30:51.810276 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.810251    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="02af20a3ada2f6d0d179599bf0fb9491e7940bc6f071c6cdd27e733bf921e262" exitCode=0
Jul 07 15:30:51.810365 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.810295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"02af20a3ada2f6d0d179599bf0fb9491e7940bc6f071c6cdd27e733bf921e262"}
Jul 07 15:30:51.825766 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.825721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z" podStartSLOduration=1.729680155 podStartE2EDuration="7.825708376s" totalImagesPullingTime="6.096028221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:51.82496761 +0000 UTC m=+47.849164881" watchObservedRunningTime="2026-07-07 15:30:51.825708376 +0000 UTC m=+47.849905645"
Jul 07 15:30:51.844616 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.844553    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-4kfh8" podStartSLOduration=1.873943521 podStartE2EDuration="7.844533734s" totalImagesPullingTime="5.970590213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:51.843112961 +0000 UTC m=+47.867310228" watchObservedRunningTime="2026-07-07 15:30:51.844533734 +0000 UTC m=+47.868730984"
Jul 07 15:30:51.897452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.897423    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"]
Jul 07 15:30:51.928296 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.928269    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"]
Jul 07 15:30:51.928427 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.928372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.931577 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.931557    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 15:30:51.931697 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.931559    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 15:30:51.931932 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.931913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 15:30:51.932165 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.932150    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 15:30:51.932244 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.932174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 15:30:51.932394 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.932379    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 15:30:51.932658 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.932637    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 15:30:51.984642 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.984826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.984826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.984826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9h94\" (UniqueName: \"kubernetes.io/projected/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-kube-api-access-q9h94\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.984979 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:51.984979 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:51.984848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085786 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9h94\" (UniqueName: \"kubernetes.io/projected/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-kube-api-access-q9h94\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.085931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.085924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.087029 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.086961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.088891 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.088865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-ca\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.089146 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.089098    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.089978 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.089946    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.090055 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.090044    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.094929 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.094909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9h94\" (UniqueName: \"kubernetes.io/projected/e1e23aec-8034-4989-b681-7ff2fb0c9ebf-kube-api-access-q9h94\") pod \"cluster-proxy-proxy-agent-76d75479c9-6tfrx\" (UID: \"e1e23aec-8034-4989-b681-7ff2fb0c9ebf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.249710 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.249667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:30:52.287757 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.287728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:30:52.287913 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:52.287891    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:52.287990 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:52.287970    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.287952083 +0000 UTC m=+56.312149334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:30:52.388944 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.388894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:30:52.389114 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:52.389060    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:30:52.389181 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:52.389138    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls podName:db707a51-4d17-4bd2-a9fa-71cb802aeef6 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.389120698 +0000 UTC m=+56.413317964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29mtn" (UID: "db707a51-4d17-4bd2-a9fa-71cb802aeef6") : secret "samples-operator-tls" not found
Jul 07 15:30:52.409287 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.409252    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"]
Jul 07 15:30:52.413316 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:30:52.413275    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1e23aec_8034_4989_b681_7ff2fb0c9ebf.slice/crio-3a03337bde36f0124cbe52202836f629d6621e761d1a44d7b18df21faf5e15ad WatchSource:0}: Error finding container 3a03337bde36f0124cbe52202836f629d6621e761d1a44d7b18df21faf5e15ad: Status 404 returned error can't find the container with id 3a03337bde36f0124cbe52202836f629d6621e761d1a44d7b18df21faf5e15ad
Jul 07 15:30:52.448660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.448618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:52.549460 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.549430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:52.751956 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.751933    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8vpk_65803f05-64dc-47f2-a0f5-1087a948de3a/node-ca/0.log"
Jul 07 15:30:52.814667 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.814628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerStarted","Data":"3a03337bde36f0124cbe52202836f629d6621e761d1a44d7b18df21faf5e15ad"}
Jul 07 15:30:52.817763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.817736    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfd968ec-4e1c-465a-a03c-11655b86852d" containerID="fa1a2f0d400c9ece900ac440339d855848a7df7ca9073add5f664b58fa633002" exitCode=0
Jul 07 15:30:52.817897 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.817811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerDied","Data":"fa1a2f0d400c9ece900ac440339d855848a7df7ca9073add5f664b58fa633002"}
Jul 07 15:30:52.891500 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.891441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:52.993219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:52.993182    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:53.354044 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.354017    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fjlr2_7c4202c0-44f7-4c01-be06-c624e8b2ad06/serve-healthcheck-canary/0.log"
Jul 07 15:30:53.396599 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.396563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:53.396772 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.396622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:53.396772 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:53.396688    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:53.396772 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:53.396728    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:53.396772 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:53.396754    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.396739723 +0000 UTC m=+53.420936972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:53.396772 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:53.396773    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.39676201 +0000 UTC m=+53.420959258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:53.745343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.745308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:53.828123 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.827545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8twb" event={"ID":"cfd968ec-4e1c-465a-a03c-11655b86852d","Type":"ContainerStarted","Data":"1dae70e04f94d8089ace875d197b400d9d5d32964007d01d7ac18095d54f6f74"}
Jul 07 15:30:53.830633 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.830592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz" event={"ID":"62063ce6-e339-4681-a2a2-b7e4e73db212","Type":"ContainerStarted","Data":"596a3d084600635b07761d454ca4f392d86c522fe3e34f6a2431f49b89a00034"}
Jul 07 15:30:53.830780 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.830651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz" event={"ID":"62063ce6-e339-4681-a2a2-b7e4e73db212","Type":"ContainerStarted","Data":"757e42f4bb516ef5a3e9cd7a7f2d04b3816f55ec2b1b74f636e66e661e808ba2"}
Jul 07 15:30:53.853299 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.853263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:53.868824 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.868774    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f8twb" podStartSLOduration=7.937340208 podStartE2EDuration="48.868759325s" totalImagesPullingTime="40.931419117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:53.868704533 +0000 UTC m=+49.892901807" watchObservedRunningTime="2026-07-07 15:30:53.868759325 +0000 UTC m=+49.892956594"
Jul 07 15:30:53.891197 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:53.891096    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hbnxz" podStartSLOduration=2.564758919 podStartE2EDuration="4.891060293s" totalImagesPullingTime="2.326301374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:53.888912284 +0000 UTC m=+49.913109554" watchObservedRunningTime="2026-07-07 15:30:53.891060293 +0000 UTC m=+49.915257562"
Jul 07 15:30:54.612644 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:54.612572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:54.684734 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:54.684696    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:54.804129 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:54.804092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:55.715961 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:55.715922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:30:55.716390 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:55.716138    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:55.716390 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:55.716215    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls podName:41c75795-2322-445f-9d4f-6b824fffd84a nodeName:}" failed. No retries permitted until 2026-07-07 15:31:11.716193982 +0000 UTC m=+67.740391238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls") pod "dns-default-jd5qn" (UID: "41c75795-2322-445f-9d4f-6b824fffd84a") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:55.813832 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:55.813790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:57.432436 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.432349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:57.432814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.432454    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:30:57.432814 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:57.432510    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:57.432814 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:57.432527    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:57.432814 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:57.432588    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.432574359 +0000 UTC m=+61.456771607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:57.432814 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:30:57.432601    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.432595157 +0000 UTC m=+61.456792406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:57.845309 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.845274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerStarted","Data":"18eec5f0c72ed85ee990b16d1245ffc3f79055a6bc16470fc3ab099df6a439a4"}
Jul 07 15:30:57.845309 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.845316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerStarted","Data":"6f6ba20b67aa7aced652dcf1a9ec318edad4e150ae5d1392d88c684f12e01f5a"}
Jul 07 15:30:57.845564 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.845330    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerStarted","Data":"c00096134f0d7e6c346eff78e3dccd8d035e6361daeffb29cd328a697b154b56"}
Jul 07 15:30:57.872853 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:57.872790    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" podStartSLOduration=2.473890335 podStartE2EDuration="6.872773933s" totalImagesPullingTime="4.398883598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:57.87272183 +0000 UTC m=+53.896919099" watchObservedRunningTime="2026-07-07 15:30:57.872773933 +0000 UTC m=+53.896971203"
Jul 07 15:30:59.024174 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.024137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.137778 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.137742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.367478 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.367393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.467940 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.467905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.572084 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.572025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.776017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.775982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:30:59.870297 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:30:59.870261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:00.358177 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.358138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:31:00.358554 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:31:00.358291    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:31:00.358554 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:31:00.358357    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls podName:ac632044-97a4-4d4b-927a-9e178525ed1e nodeName:}" failed. No retries permitted until 2026-07-07 15:31:16.358341585 +0000 UTC m=+72.382538836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2r85g" (UID: "ac632044-97a4-4d4b-927a-9e178525ed1e") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:31:00.458565 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.458525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:31:00.461137 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.461112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db707a51-4d17-4bd2-a9fa-71cb802aeef6-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29mtn\" (UID: \"db707a51-4d17-4bd2-a9fa-71cb802aeef6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:31:00.486020 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.485992    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"
Jul 07 15:31:00.623863 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.623790    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn"]
Jul 07 15:31:00.856127 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:00.856090    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn" event={"ID":"db707a51-4d17-4bd2-a9fa-71cb802aeef6","Type":"ContainerStarted","Data":"25c7c3ed0d4b5d57c131a99e3965c4960bef96e8f857364d5a297e01ecb1f004"}
Jul 07 15:31:01.293687 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:01.293655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:01.391426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:01.391393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:01.533256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:01.533212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:01.748174 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:01.748131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:01.852440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:01.852401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:02.720126 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:02.720058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:02.821227 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:02.821194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:02.939711 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:02.939673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:03.328945 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.328916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:03.529669 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.529646    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:03.628762 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.628685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:03.870118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.870059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn" event={"ID":"db707a51-4d17-4bd2-a9fa-71cb802aeef6","Type":"ContainerStarted","Data":"ab239d8dc739bdc4f5f4d6674aa5c9f839881ab06abfdd67b4f5cfd3e2364497"}
Jul 07 15:31:03.870486 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.870171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn" event={"ID":"db707a51-4d17-4bd2-a9fa-71cb802aeef6","Type":"ContainerStarted","Data":"7edd4a23ed68318b7742ea479dcf4e58d87d32dd10a2688952f0358de669caa5"}
Jul 07 15:31:03.895769 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.895655    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29mtn" podStartSLOduration=17.106655123 podStartE2EDuration="19.895637942s" totalImagesPullingTime="2.788982819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:03.895354541 +0000 UTC m=+59.919551810" watchObservedRunningTime="2026-07-07 15:31:03.895637942 +0000 UTC m=+59.919835189"
Jul 07 15:31:03.936101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:03.936033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:04.391951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:04.391914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:04.488598 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:04.488562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:04.581122 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:04.581090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:04.925973 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:04.925941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:05.140901 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.140864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:05.250018 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.249991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:05.498276 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.498239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:05.498454 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.498297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:05.498454 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:31:05.498408    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:31:05.498522 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:31:05.498466    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls podName:7d086fd7-1764-4a45-ad07-9d142c5ea357 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:21.4984518 +0000 UTC m=+77.522649048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2q77" (UID: "7d086fd7-1764-4a45-ad07-9d142c5ea357") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:31:05.498761 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.498733    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d086fd7-1764-4a45-ad07-9d142c5ea357-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:05.573005 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.572926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:05.764051 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:05.764023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hg4wb"
Jul 07 15:31:06.139967 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:06.139924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:06.333860 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:06.333825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:06.924914 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:06.924886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:07.294715 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:07.294683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:07.524263 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:07.524207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:07.724280 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:07.724182    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:07.926575 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:07.926529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:08.373032 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:08.373002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:08.731359 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:08.731329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:09.334763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:09.334736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:09.573507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:09.573473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:09.750612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:09.750583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:10.335183 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.335152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:31:10.335360 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.335198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:31:10.338274 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.338247    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:31:10.339285 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.339267    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:31:10.347634 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.347605    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1d63266-f946-42f2-830c-9aa08621d127-original-pull-secret\") pod \"global-pull-secret-syncer-8gfbn\" (UID: \"c1d63266-f946-42f2-830c-9aa08621d127\") " pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:31:10.347734 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.347636    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2af92310-b8b2-4d39-a30a-3d2b80cc2537-metrics-certs\") pod \"network-metrics-daemon-f2f5c\" (UID: \"2af92310-b8b2-4d39-a30a-3d2b80cc2537\") " pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:31:10.401867 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.401831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8gfbn"
Jul 07 15:31:10.435751 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.435708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:31:10.438967 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.438933    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs657\" (UniqueName: \"kubernetes.io/projected/d0402b9e-101a-4466-bb46-b4db4ae74042-kube-api-access-cs657\") pod \"network-check-target-jlgcw\" (UID: \"d0402b9e-101a-4466-bb46-b4db4ae74042\") " pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:31:10.530652 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.530622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8gfbn"]
Jul 07 15:31:10.533907 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:10.533876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d63266_f946_42f2_830c_9aa08621d127.slice/crio-71ed173b5a6021552d8f60c08a0d67e8da35d2342b86039423ccc18d4963e143 WatchSource:0}: Error finding container 71ed173b5a6021552d8f60c08a0d67e8da35d2342b86039423ccc18d4963e143: Status 404 returned error can't find the container with id 71ed173b5a6021552d8f60c08a0d67e8da35d2342b86039423ccc18d4963e143
Jul 07 15:31:10.604189 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.604131    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\""
Jul 07 15:31:10.608418 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.608390    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\""
Jul 07 15:31:10.612645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.612626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2f5c"
Jul 07 15:31:10.616613 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.616592    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:31:10.755609 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.755588    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f2f5c"]
Jul 07 15:31:10.757877 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:10.757854    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af92310_b8b2_4d39_a30a_3d2b80cc2537.slice/crio-0d43f86141e25ffb1bf61adf275bc08c331d24fdb64b446613224f056669a32a WatchSource:0}: Error finding container 0d43f86141e25ffb1bf61adf275bc08c331d24fdb64b446613224f056669a32a: Status 404 returned error can't find the container with id 0d43f86141e25ffb1bf61adf275bc08c331d24fdb64b446613224f056669a32a
Jul 07 15:31:10.766708 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.766655    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jlgcw"]
Jul 07 15:31:10.770572 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:10.770551    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0402b9e_101a_4466_bb46_b4db4ae74042.slice/crio-bdff7e407c9c70afe1c2b126cc669dba84254e28c3b402a9daaddb900ed7f1b2 WatchSource:0}: Error finding container bdff7e407c9c70afe1c2b126cc669dba84254e28c3b402a9daaddb900ed7f1b2: Status 404 returned error can't find the container with id bdff7e407c9c70afe1c2b126cc669dba84254e28c3b402a9daaddb900ed7f1b2
Jul 07 15:31:10.880784 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.880756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:10.892699 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.892672    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jlgcw" event={"ID":"d0402b9e-101a-4466-bb46-b4db4ae74042","Type":"ContainerStarted","Data":"daf19b5c1d511fc971afdc71d8ffce9b8a73919bba97171309b60757398e1cc8"}
Jul 07 15:31:10.892821 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.892760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jlgcw" event={"ID":"d0402b9e-101a-4466-bb46-b4db4ae74042","Type":"ContainerStarted","Data":"bdff7e407c9c70afe1c2b126cc669dba84254e28c3b402a9daaddb900ed7f1b2"}
Jul 07 15:31:10.893751 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.893732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2f5c" event={"ID":"2af92310-b8b2-4d39-a30a-3d2b80cc2537","Type":"ContainerStarted","Data":"0d43f86141e25ffb1bf61adf275bc08c331d24fdb64b446613224f056669a32a"}
Jul 07 15:31:10.894755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:10.894734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gfbn" event={"ID":"c1d63266-f946-42f2-830c-9aa08621d127","Type":"ContainerStarted","Data":"71ed173b5a6021552d8f60c08a0d67e8da35d2342b86039423ccc18d4963e143"}
Jul 07 15:31:11.040785 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.040747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.161392 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.161286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.263599 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.263556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.385295 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.385246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.746313 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.746276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:31:11.749314 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.749292    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c75795-2322-445f-9d4f-6b824fffd84a-metrics-tls\") pod \"dns-default-jd5qn\" (UID: \"41c75795-2322-445f-9d4f-6b824fffd84a\") " pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:31:11.757431 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.757398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.818735 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.818689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:11.897711 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.897686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:31:11.919225 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.919179    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jlgcw" podStartSLOduration=66.919164376 podStartE2EDuration="1m6.919164376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:11.918507773 +0000 UTC m=+67.942705042" watchObservedRunningTime="2026-07-07 15:31:11.919164376 +0000 UTC m=+67.943361646"
Jul 07 15:31:11.945988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.945960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\""
Jul 07 15:31:11.953450 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.953421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:31:11.956586 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:11.956552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:12.123274 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.123032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd5qn"]
Jul 07 15:31:12.126697 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.126669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:12.312665 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:12.312592    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c75795_2322_445f_9d4f_6b824fffd84a.slice/crio-c59e0d5f9e8fc9a85784b82c5d940a31abf1a40ccd81f1139dc27c6a4a296419 WatchSource:0}: Error finding container c59e0d5f9e8fc9a85784b82c5d940a31abf1a40ccd81f1139dc27c6a4a296419: Status 404 returned error can't find the container with id c59e0d5f9e8fc9a85784b82c5d940a31abf1a40ccd81f1139dc27c6a4a296419
Jul 07 15:31:12.356798 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.356775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:12.567795 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.567724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:12.877691 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.877618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:12.902445 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.902416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd5qn" event={"ID":"41c75795-2322-445f-9d4f-6b824fffd84a","Type":"ContainerStarted","Data":"c59e0d5f9e8fc9a85784b82c5d940a31abf1a40ccd81f1139dc27c6a4a296419"}
Jul 07 15:31:12.904097 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.904055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2f5c" event={"ID":"2af92310-b8b2-4d39-a30a-3d2b80cc2537","Type":"ContainerStarted","Data":"86ada0f969712da3071416399ce99177d39aede83bdfd482ba4a61f97b3dfcab"}
Jul 07 15:31:12.904218 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.904119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2f5c" event={"ID":"2af92310-b8b2-4d39-a30a-3d2b80cc2537","Type":"ContainerStarted","Data":"e362313a1ca849257eb14ad1bf3095a719da42b0eef26d9c0586cc93d7f61cc0"}
Jul 07 15:31:12.923547 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:12.923493    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f2f5c" podStartSLOduration=66.33787629 podStartE2EDuration="1m7.923478667s" totalImagesPullingTime="1.585602377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:12.922604576 +0000 UTC m=+68.946801847" watchObservedRunningTime="2026-07-07 15:31:12.923478667 +0000 UTC m=+68.947675936"
Jul 07 15:31:13.599240 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:13.599205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:15.915542 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:15.915505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8gfbn" event={"ID":"c1d63266-f946-42f2-830c-9aa08621d127","Type":"ContainerStarted","Data":"9cd0f668d8f7ac4d1a2c3796d3fb195ef43b7d4645b2d3f0505c7cd97c3af68d"}
Jul 07 15:31:15.936832 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:15.936787    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8gfbn" podStartSLOduration=66.097331173 podStartE2EDuration="1m10.936766396s" totalImagesPullingTime="4.839435223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:15.935462815 +0000 UTC m=+71.959660086" watchObservedRunningTime="2026-07-07 15:31:15.936766396 +0000 UTC m=+71.960963670"
Jul 07 15:31:16.386184 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.386140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:31:16.388714 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.388684    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac632044-97a4-4d4b-927a-9e178525ed1e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2r85g\" (UID: \"ac632044-97a4-4d4b-927a-9e178525ed1e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:31:16.489408 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.489367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:16.576455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.576423    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8zfd8\""
Jul 07 15:31:16.584671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.584649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"
Jul 07 15:31:16.587819 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.587781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:16.708994 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.708959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:16.722250 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.722226    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g"]
Jul 07 15:31:16.725421 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:16.725394    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac632044_97a4_4d4b_927a_9e178525ed1e.slice/crio-90298d103ae52deacd7e57dc5d2780e02c969634e1b49cf7a7acb2372efa7780 WatchSource:0}: Error finding container 90298d103ae52deacd7e57dc5d2780e02c969634e1b49cf7a7acb2372efa7780: Status 404 returned error can't find the container with id 90298d103ae52deacd7e57dc5d2780e02c969634e1b49cf7a7acb2372efa7780
Jul 07 15:31:16.785453 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.785422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:16.920283 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.920174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g" event={"ID":"ac632044-97a4-4d4b-927a-9e178525ed1e","Type":"ContainerStarted","Data":"90298d103ae52deacd7e57dc5d2780e02c969634e1b49cf7a7acb2372efa7780"}
Jul 07 15:31:16.922144 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.922119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd5qn" event={"ID":"41c75795-2322-445f-9d4f-6b824fffd84a","Type":"ContainerStarted","Data":"60c2022158d1676525cfa2f58d83d60e4d83d9877fe06d5277e9a0975a93224e"}
Jul 07 15:31:16.922246 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.922169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd5qn" event={"ID":"41c75795-2322-445f-9d4f-6b824fffd84a","Type":"ContainerStarted","Data":"d71147d02f2ed43b65bbbd962f14808b9e94d1d251088099e98594cb4ce7ae63"}
Jul 07 15:31:16.945512 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:16.945466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jd5qn" podStartSLOduration=34.343795617 podStartE2EDuration="37.945450915s" totalImagesPullingTime="3.601655298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:16.944563905 +0000 UTC m=+72.968761181" watchObservedRunningTime="2026-07-07 15:31:16.945450915 +0000 UTC m=+72.969648185"
Jul 07 15:31:17.926038 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:17.926007    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:31:18.738282 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:18.738243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:18.849106 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:18.849051    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:19.739412 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:19.739375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:19.841916 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:19.841881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:19.935126 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:19.935086    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g" event={"ID":"ac632044-97a4-4d4b-927a-9e178525ed1e","Type":"ContainerStarted","Data":"97fe35a9dbb5582487a9e6e86a5634efe6450ab40762d7242e9f6d7ec3d08fd2"}
Jul 07 15:31:19.938155 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:19.938117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:19.952903 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:19.952863    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2r85g" podStartSLOduration=33.320215244 podStartE2EDuration="35.952843299s" totalImagesPullingTime="2.632628055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:19.952046247 +0000 UTC m=+75.976243518" watchObservedRunningTime="2026-07-07 15:31:19.952843299 +0000 UTC m=+75.977040570"
Jul 07 15:31:20.083496 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:20.083415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:21.525883 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.525850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:21.528179 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.528156    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d086fd7-1764-4a45-ad07-9d142c5ea357-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2q77\" (UID: \"7d086fd7-1764-4a45-ad07-9d142c5ea357\") " pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:21.689271 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.689239    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r642f\""
Jul 07 15:31:21.696740 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.696721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2q77"
Jul 07 15:31:21.854407 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.854377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2q77"]
Jul 07 15:31:21.857615 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:21.857584    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d086fd7_1764_4a45_ad07_9d142c5ea357.slice/crio-fadb7612e4d5230e3da92d3679ea40c3519da5b812963be62d606528aaaaca63 WatchSource:0}: Error finding container fadb7612e4d5230e3da92d3679ea40c3519da5b812963be62d606528aaaaca63: Status 404 returned error can't find the container with id fadb7612e4d5230e3da92d3679ea40c3519da5b812963be62d606528aaaaca63
Jul 07 15:31:21.942827 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:21.942788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2q77" event={"ID":"7d086fd7-1764-4a45-ad07-9d142c5ea357","Type":"ContainerStarted","Data":"fadb7612e4d5230e3da92d3679ea40c3519da5b812963be62d606528aaaaca63"}
Jul 07 15:31:23.950184 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:23.950127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:24.056807 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:24.056742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:24.481320 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:24.481282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:25.960042 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:25.960006    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2q77" event={"ID":"7d086fd7-1764-4a45-ad07-9d142c5ea357","Type":"ContainerStarted","Data":"e674c5f659e9de88be760bd3e20051e207d8ce556520a629ecedc42449932433"}
Jul 07 15:31:26.685659 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:26.685632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:26.788012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:26.787984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:26.888678 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:26.888647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:26.965448 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:26.965363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2q77" event={"ID":"7d086fd7-1764-4a45-ad07-9d142c5ea357","Type":"ContainerStarted","Data":"3e67ebe1923bf681aa6d023457b2025f4fd22864b7f4953418ab58b35ceb38fe"}
Jul 07 15:31:26.988532 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:26.988503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:27.933012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:27.932978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jd5qn"
Jul 07 15:31:28.213186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:28.213107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:28.278552 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:28.278515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:28.763385 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:28.763346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:29.797867 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:29.797828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:29.977311 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:29.977275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2q77" event={"ID":"7d086fd7-1764-4a45-ad07-9d142c5ea357","Type":"ContainerStarted","Data":"bb07fdc4d56ec068fca7bb64bb0278a56b62a9c9440c2d33178582e14cdf98e1"}
Jul 07 15:31:31.160264 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.160236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.381293 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.381255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.493649 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.493621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.506778 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.506703    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t2q77" podStartSLOduration=34.877900523 podStartE2EDuration="42.506687626s" totalImagesPullingTime="7.628787103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:30.00191737 +0000 UTC m=+86.026114641" watchObservedRunningTime="2026-07-07 15:31:31.506687626 +0000 UTC m=+87.530884896"
Jul 07 15:31:31.507251 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.507236    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gqgwr"]
Jul 07 15:31:31.509707 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.509689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.516641 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.516619    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:31:31.517626 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.517608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8qcf\""
Jul 07 15:31:31.517722 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.517643    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:31:31.517722 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.517680    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:31:31.517722 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.517685    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:31:31.598498 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-metrics-client-ca\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598498 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-root\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwdkv\" (UniqueName: \"kubernetes.io/projected/6166dad2-3d10-4cc4-86bb-a07c8270514f-kube-api-access-bwdkv\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-textfile\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-sys\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598864 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-wtmp\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598864 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.598864 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.598777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-tls\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.600551 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.600526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.698280 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.698244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.699256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-metrics-client-ca\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-root\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwdkv\" (UniqueName: \"kubernetes.io/projected/6166dad2-3d10-4cc4-86bb-a07c8270514f-kube-api-access-bwdkv\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699469 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-root\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699577 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-textfile\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699657 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-sys\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699657 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-wtmp\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699758 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699758 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-tls\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699758 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-sys\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699909 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-wtmp\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699910    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-textfile\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.699962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-metrics-client-ca\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.700049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.699964    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.702118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.702094    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-tls\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.702220 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.702175    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6166dad2-3d10-4cc4-86bb-a07c8270514f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.713517 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.713489    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwdkv\" (UniqueName: \"kubernetes.io/projected/6166dad2-3d10-4cc4-86bb-a07c8270514f-kube-api-access-bwdkv\") pod \"node-exporter-gqgwr\" (UID: \"6166dad2-3d10-4cc4-86bb-a07c8270514f\") " pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.818671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.818589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqgwr"
Jul 07 15:31:31.826629 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.826580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.829756 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:31.829733    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6166dad2_3d10_4cc4_86bb_a07c8270514f.slice/crio-4480d42c46ec4e5e77f9eba15faf42a116e22457b6751b4dbe3667cc1158f9d6 WatchSource:0}: Error finding container 4480d42c46ec4e5e77f9eba15faf42a116e22457b6751b4dbe3667cc1158f9d6: Status 404 returned error can't find the container with id 4480d42c46ec4e5e77f9eba15faf42a116e22457b6751b4dbe3667cc1158f9d6
Jul 07 15:31:31.984473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.984437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:31.984941 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:31.984917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqgwr" event={"ID":"6166dad2-3d10-4cc4-86bb-a07c8270514f","Type":"ContainerStarted","Data":"4480d42c46ec4e5e77f9eba15faf42a116e22457b6751b4dbe3667cc1158f9d6"}
Jul 07 15:31:32.314713 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:32.314675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:32.431187 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:32.431159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:32.529092 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:32.529044    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:32.669260 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:32.669176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:32.856759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:32.856632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:33.994396 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:33.994357    2573 generic.go:356] "Generic (PLEG): container finished" podID="6166dad2-3d10-4cc4-86bb-a07c8270514f" containerID="45396be6beaffb3bfd463c3979bfeef94ba7a13e0a985c53d357e5c95dbaf582" exitCode=0
Jul 07 15:31:33.994748 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:33.994412    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqgwr" event={"ID":"6166dad2-3d10-4cc4-86bb-a07c8270514f","Type":"ContainerDied","Data":"45396be6beaffb3bfd463c3979bfeef94ba7a13e0a985c53d357e5c95dbaf582"}
Jul 07 15:31:34.200875 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:34.200825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:34.308819 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:34.308715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:34.618238 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:34.618122    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:34.693301 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:34.693240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:34.823336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:34.823300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:35.000244 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:35.000215    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqgwr" event={"ID":"6166dad2-3d10-4cc4-86bb-a07c8270514f","Type":"ContainerStarted","Data":"b574fcfade6cd94056f6feb1cac5009ab0628d98b434047923a8d1412b9c53e7"}
Jul 07 15:31:35.000688 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:35.000265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqgwr" event={"ID":"6166dad2-3d10-4cc4-86bb-a07c8270514f","Type":"ContainerStarted","Data":"a50a2a29a9396a122b44871b82ae4433ff8ff44c98a9761206798fc90a3458fe"}
Jul 07 15:31:35.094985 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:35.094953    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:36.091773 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.091735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:36.175409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.175380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:36.271786 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.271742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:36.457703 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.457630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:36.747106 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.746994    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gqgwr" podStartSLOduration=4.389813627 podStartE2EDuration="5.746972719s" totalImagesPullingTime="1.283193384s" totalInitContainerRuntime="73.965708ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:35.027480989 +0000 UTC m=+91.051678259" watchObservedRunningTime="2026-07-07 15:31:36.746972719 +0000 UTC m=+92.771169991"
Jul 07 15:31:36.749106 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.749061    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"]
Jul 07 15:31:36.753744 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.753724    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.757748 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.757729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 15:31:36.758560 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.758542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 15:31:36.758660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.758640    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 15:31:36.758750 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.758679    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 15:31:36.758802 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.758783    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sls26\""
Jul 07 15:31:36.759025 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.759008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 15:31:36.766105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.766086    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 15:31:36.779565 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.779540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"]
Jul 07 15:31:36.840533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-metrics-client-ca\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-serving-certs-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840763 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840940 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-federate-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.840940 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.840824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrj8\" (UniqueName: \"kubernetes.io/projected/3e66a81e-5995-45e3-bf7c-9452c90d6c25-kube-api-access-gvrj8\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941677 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-federate-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941677 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrj8\" (UniqueName: \"kubernetes.io/projected/3e66a81e-5995-45e3-bf7c-9452c90d6c25-kube-api-access-gvrj8\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-metrics-client-ca\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.941918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-serving-certs-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.942169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.941936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.942679 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.942652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-serving-certs-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.942820 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.942775    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-metrics-client-ca\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.943049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.943025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.944335 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.944308    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-federate-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.944467 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.944446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-telemeter-client-tls\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.944529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.944452    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.944529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.944458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e66a81e-5995-45e3-bf7c-9452c90d6c25-secret-telemeter-client\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:36.957894 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:36.957869    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrj8\" (UniqueName: \"kubernetes.io/projected/3e66a81e-5995-45e3-bf7c-9452c90d6c25-kube-api-access-gvrj8\") pod \"telemeter-client-77b79cf6bd-nvdks\" (UID: \"3e66a81e-5995-45e3-bf7c-9452c90d6c25\") " pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:37.062801 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.062715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"
Jul 07 15:31:37.203092 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.203051    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77b79cf6bd-nvdks"]
Jul 07 15:31:37.204663 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:37.204638    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e66a81e_5995_45e3_bf7c_9452c90d6c25.slice/crio-1b12039d3fe087295eaee8eb801e0789cb89095866021b4e48e2ad11d543e35a WatchSource:0}: Error finding container 1b12039d3fe087295eaee8eb801e0789cb89095866021b4e48e2ad11d543e35a: Status 404 returned error can't find the container with id 1b12039d3fe087295eaee8eb801e0789cb89095866021b4e48e2ad11d543e35a
Jul 07 15:31:37.830297 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.830258    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 15:31:37.833665 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.833641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.836588 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.836570    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 15:31:37.837165 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.837149    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 15:31:37.837573 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.837552    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 15:31:37.837953 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.837928    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 15:31:37.838055 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.837941    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b7lsr\""
Jul 07 15:31:37.838055 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.837995    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8p7ruaceek5qn\""
Jul 07 15:31:37.838289 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838193    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 15:31:37.838289 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838203    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 15:31:37.838402 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838260    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 15:31:37.838402 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 15:31:37.838402 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838274    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 15:31:37.838549 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 15:31:37.838754 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838732    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 15:31:37.838832 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.838775    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 15:31:37.839390 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.839371    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 15:31:37.843653 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.843635    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 15:31:37.846428 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.846413    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 15:31:37.855331 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.855308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 15:31:37.873314 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.873286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:37.948949 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.948909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.948956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.948989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69g98\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-kube-api-access-69g98\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949532 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949532 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949532 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949929 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.949929 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.949747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:37.967542 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:37.967509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.011991 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.011957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks" event={"ID":"3e66a81e-5995-45e3-bf7c-9452c90d6c25","Type":"ContainerStarted","Data":"1b12039d3fe087295eaee8eb801e0789cb89095866021b4e48e2ad11d543e35a"}
Jul 07 15:31:38.050351 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050351 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050567 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050567    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69g98\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-kube-api-access-69g98\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.050988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.050828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.051605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.051057    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.051605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.051341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.051605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.051458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.051759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.051732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.053486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.053878    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054357    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.054936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.055169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.055048    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4597041b-c510-4450-8198-54d59a39dcb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.056517 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.056480    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4597041b-c510-4450-8198-54d59a39dcb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.056649 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.056519    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.056906 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.056877    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.057085 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.057046    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.057249 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.057234    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.057344 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.057326    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4597041b-c510-4450-8198-54d59a39dcb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.066507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.066488    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69g98\" (UniqueName: \"kubernetes.io/projected/4597041b-c510-4450-8198-54d59a39dcb4-kube-api-access-69g98\") pod \"prometheus-k8s-0\" (UID: \"4597041b-c510-4450-8198-54d59a39dcb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.144120 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.144025    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:38.293758 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.293721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 15:31:38.298990 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:31:38.298967    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4597041b_c510_4450_8198_54d59a39dcb4.slice/crio-151530dab36e38c57c51db0be2ed79e043da3bd61c635ad0c6ade9daf8ab15a4 WatchSource:0}: Error finding container 151530dab36e38c57c51db0be2ed79e043da3bd61c635ad0c6ade9daf8ab15a4: Status 404 returned error can't find the container with id 151530dab36e38c57c51db0be2ed79e043da3bd61c635ad0c6ade9daf8ab15a4
Jul 07 15:31:38.406951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.406865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.492186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.492156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.592379 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.592347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.655475 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.655431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.771381 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.771345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:38.877792 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:38.877757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:39.018953 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:39.018913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"151530dab36e38c57c51db0be2ed79e043da3bd61c635ad0c6ade9daf8ab15a4"}
Jul 07 15:31:40.024130 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.024019    2573 generic.go:356] "Generic (PLEG): container finished" podID="4597041b-c510-4450-8198-54d59a39dcb4" containerID="92e7ac39f2e3a5d034e581d94510fb74cb4111e5d832b07538e7c064059c388a" exitCode=0
Jul 07 15:31:40.024130 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.024111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerDied","Data":"92e7ac39f2e3a5d034e581d94510fb74cb4111e5d832b07538e7c064059c388a"}
Jul 07 15:31:40.026383 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.026362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks" event={"ID":"3e66a81e-5995-45e3-bf7c-9452c90d6c25","Type":"ContainerStarted","Data":"5d14e4e5aa99c6de7d81fb1c34d734afc86482e8c7340be46a0a2d8d19e5c4a6"}
Jul 07 15:31:40.026479 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.026409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks" event={"ID":"3e66a81e-5995-45e3-bf7c-9452c90d6c25","Type":"ContainerStarted","Data":"0fead5e5a75c99d67ef46ffb9ff8b95bcbf3b24171bd5e8822d469be3ba034c5"}
Jul 07 15:31:40.026479 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.026428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks" event={"ID":"3e66a81e-5995-45e3-bf7c-9452c90d6c25","Type":"ContainerStarted","Data":"2b780ed95d41d757661eebf59ed2ff0d3abfade8be813c82a4d73f97a4c77a5b"}
Jul 07 15:31:40.095724 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:40.095676    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77b79cf6bd-nvdks" podStartSLOduration=1.549165873 podStartE2EDuration="4.095662808s" totalImagesPullingTime="2.546496935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:40.095298516 +0000 UTC m=+96.119495808" watchObservedRunningTime="2026-07-07 15:31:40.095662808 +0000 UTC m=+96.119860077"
Jul 07 15:31:41.067320 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:41.067278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:41.166520 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:41.166484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:42.907473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:42.907442    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jlgcw"
Jul 07 15:31:44.047006 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:44.046970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"023ab529995a63a18b70bb978b049362a9822a8faf79783df7f2a7ba3d09d9fa"}
Jul 07 15:31:44.047392 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:44.047050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"4f60ee486d30c076ebfe2759e01446c363c092b31e73f78705a404039eabc6ae"}
Jul 07 15:31:46.058495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.058406    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"18b1e318f8bc1009959955c5f1a5ec085c0de54be110f4c3e494ec4c91716da2"}
Jul 07 15:31:46.058495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.058486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"ad3e5766298de6d8de24b7dad0d0209d98a371f5636ace1e969be2ecb853ae40"}
Jul 07 15:31:46.058962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.058526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"dcbe8a8251b89f65c8521e7b0382ebd72d1919a9f4bdaf791033f5386dec75bd"}
Jul 07 15:31:46.058962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.058565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4597041b-c510-4450-8198-54d59a39dcb4","Type":"ContainerStarted","Data":"a92e79c6ee3a212e364877fce203fba60db25340907f5816edf03b65f9685f9b"}
Jul 07 15:31:46.100354 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.100295    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.256133144 podStartE2EDuration="9.100277358s" totalImagesPullingTime="6.821810821s" totalInitContainerRuntime="22.333393ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:46.099451063 +0000 UTC m=+102.123648356" watchObservedRunningTime="2026-07-07 15:31:46.100277358 +0000 UTC m=+102.124474628"
Jul 07 15:31:46.786735 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.786700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:46.863227 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:46.863197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:48.144398 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:48.144369    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:31:48.153962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:48.153934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:48.225327 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:48.225282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:49.423501 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:49.423466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:49.513412 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:49.513382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:51.852060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:51.852027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:51.948759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:51.948729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:31:52.055959 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:31:52.055916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:04.362833 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:04.362797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:04.460209 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:04.460172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:12.156298 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:12.156216    2573 generic.go:356] "Generic (PLEG): container finished" podID="9814154f-5e50-4cca-87bf-bf3da7956f17" containerID="4648ad165dcee31a7ab1b2135138018c7cba41a57febe5488e6514a0c7cdfc19" exitCode=0
Jul 07 15:32:12.156298 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:12.156279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z" event={"ID":"9814154f-5e50-4cca-87bf-bf3da7956f17","Type":"ContainerDied","Data":"4648ad165dcee31a7ab1b2135138018c7cba41a57febe5488e6514a0c7cdfc19"}
Jul 07 15:32:12.156718 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:12.156588    2573 scope.go:117] "RemoveContainer" containerID="4648ad165dcee31a7ab1b2135138018c7cba41a57febe5488e6514a0c7cdfc19"
Jul 07 15:32:12.252024 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:12.251975    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" podUID="e1e23aec-8034-4989-b681-7ff2fb0c9ebf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:32:13.161680 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:13.161645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hg48z" event={"ID":"9814154f-5e50-4cca-87bf-bf3da7956f17","Type":"ContainerStarted","Data":"4ef39170aa72a9a727d47e7f9748b60beb3ffb8c0d0d34f2cc39975a7526204b"}
Jul 07 15:32:19.367185 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:19.367143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:19.433638 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:19.433577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:22.251651 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:22.251612    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" podUID="e1e23aec-8034-4989-b681-7ff2fb0c9ebf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:32:24.097671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:24.097637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:32.251314 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:32.251273    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" podUID="e1e23aec-8034-4989-b681-7ff2fb0c9ebf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:32:32.251677 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:32.251344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx"
Jul 07 15:32:32.251848 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:32.251819    2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"18eec5f0c72ed85ee990b16d1245ffc3f79055a6bc16470fc3ab099df6a439a4"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 15:32:32.251884 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:32.251869    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" podUID="e1e23aec-8034-4989-b681-7ff2fb0c9ebf" containerName="service-proxy" containerID="cri-o://18eec5f0c72ed85ee990b16d1245ffc3f79055a6bc16470fc3ab099df6a439a4" gracePeriod=30
Jul 07 15:32:33.236342 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:33.236308    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1e23aec-8034-4989-b681-7ff2fb0c9ebf" containerID="18eec5f0c72ed85ee990b16d1245ffc3f79055a6bc16470fc3ab099df6a439a4" exitCode=2
Jul 07 15:32:33.236510 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:33.236383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerDied","Data":"18eec5f0c72ed85ee990b16d1245ffc3f79055a6bc16470fc3ab099df6a439a4"}
Jul 07 15:32:33.236510 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:33.236426    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76d75479c9-6tfrx" event={"ID":"e1e23aec-8034-4989-b681-7ff2fb0c9ebf","Type":"ContainerStarted","Data":"39eff1cc4d8f56d0a2d5ac6e21bc85ca242d9edbb2e15c34e9494b9dde34fea8"}
Jul 07 15:32:38.144776 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:38.144731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:32:38.165119 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:38.165085    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:32:38.270230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:38.270203    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 15:32:47.748912 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:47.748869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:47.862018 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:47.861978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:51.031654 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:51.031623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:53.723005 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:53.722973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:53.836026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:53.835985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:59.679111 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:59.679013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:32:59.830251 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:32:59.830222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:04.380398 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:33:04.380360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:04.480300 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:33:04.480267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:05.151109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:33:05.151056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:33:05.253797 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:33:05.253761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:17.492486 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:34:17.492446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:34:17.580145 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:34:17.580111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:04.412972 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:04.412925    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:35:04.417010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:04.416986    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:35:04.419380 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:04.419359    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:35:08.571588 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:08.571547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:08.650650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:08.650615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:09.782947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:09.782911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:11.222261 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:11.222223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:13.612022 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:13.611990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:13.708121 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:13.708086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:15.031612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:15.031583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:15.161157 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:15.161125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:15.952729 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:15.952693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:16.061869 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:16.061835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:18.213898 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:18.213864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:18.622010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:18.621979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:20.188184 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:20.188154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:20.276049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:20.276015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:26.162265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:26.162227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:27.935355 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:27.935322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:31.397177 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:31.397140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:31.491759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:31.491724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:37.533971 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:37.533932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:37.656192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:37.656158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:39.398507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:39.398475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:51.209614 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:51.209574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:51.306671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:51.306638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:51.831267 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:51.831233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.037456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.037422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.134821 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.134744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.200146 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.200111    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"]
Jul 07 15:35:52.203495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.203479    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.206210 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.206179    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:35:52.206307 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.206290    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:35:52.206764 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.206748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:35:52.206876 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.206857    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:35:52.207104 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.207091    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cn75m\""
Jul 07 15:35:52.222802 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.222779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"]
Jul 07 15:35:52.300252 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.300220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.300252 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.300253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmr95\" (UniqueName: \"kubernetes.io/projected/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-kube-api-access-vmr95\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.300447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.300286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.300447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.300371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.300447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.300427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.373032 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.372999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.401490 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401412    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.401490 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.401490 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmr95\" (UniqueName: \"kubernetes.io/projected/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-kube-api-access-vmr95\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.401706 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.401759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.401896 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.401873    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.403919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.403893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.404143 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.404128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.404295 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.404277    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.414058 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.414033    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmr95\" (UniqueName: \"kubernetes.io/projected/e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed-kube-api-access-vmr95\") pod \"opendatahub-operator-controller-manager-578f9687cc-ml5r5\" (UID: \"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.463278 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.463250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.513531 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.513506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:52.597902 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.597841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:52.654546 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.654479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"]
Jul 07 15:35:52.657643 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:35:52.657618    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f2495d_9fd4_44a3_8ab9_2d2de0e7c9ed.slice/crio-49133515a691b362d7f844787c47985b19ab419fb3614b36afbe56c71322ca32 WatchSource:0}: Error finding container 49133515a691b362d7f844787c47985b19ab419fb3614b36afbe56c71322ca32: Status 404 returned error can't find the container with id 49133515a691b362d7f844787c47985b19ab419fb3614b36afbe56c71322ca32
Jul 07 15:35:52.659213 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.659198    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:35:52.953551 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:52.953467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5" event={"ID":"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed","Type":"ContainerStarted","Data":"49133515a691b362d7f844787c47985b19ab419fb3614b36afbe56c71322ca32"}
Jul 07 15:35:53.288970 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:53.288929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:53.389230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:53.389193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:55.967359 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:55.967319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5" event={"ID":"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed","Type":"ContainerStarted","Data":"d0a4081ee87640348144c12db4a6a6a32f332b51b1275cd5fd228cc422ffefda"}
Jul 07 15:35:56.972995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:56.972962    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed" containerID="d0a4081ee87640348144c12db4a6a6a32f332b51b1275cd5fd228cc422ffefda" exitCode=0
Jul 07 15:35:56.972995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:56.972998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5" event={"ID":"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed","Type":"ContainerDied","Data":"d0a4081ee87640348144c12db4a6a6a32f332b51b1275cd5fd228cc422ffefda"}
Jul 07 15:35:57.643892 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:57.643857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:57.714384 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:57.714360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:35:58.982645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:58.982612    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5" event={"ID":"e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed","Type":"ContainerStarted","Data":"9ee4a42c3cb19a37077c53ae89180fc7ec615d70e7decf43e3eed13ddb1edc8c"}
Jul 07 15:35:58.983035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:58.982731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:35:59.010243 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:35:59.010189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5" podStartSLOduration=1.854560531 podStartE2EDuration="7.010173431s" totalImagesPullingTime="4.140901728s" totalInitContainerRuntime="1.014711172s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:59.007349205 +0000 UTC m=+355.031546474" watchObservedRunningTime="2026-07-07 15:35:59.010173431 +0000 UTC m=+355.034370701"
Jul 07 15:36:09.988900 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:09.988873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-ml5r5"
Jul 07 15:36:11.788006 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:11.787968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:11.889342 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:11.889310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:12.505334 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:12.505297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:12.958630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:12.958558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:13.078294 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:13.078261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:13.234291 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:13.234262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:13.409149 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:13.409110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:14.243177 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:14.243143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:14.855188 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:14.855157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:14.965793 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:14.965762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:16.106464 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:16.106424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:20.157438 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.157402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:20.297257 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.297227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:20.553204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.553175    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"]
Jul 07 15:36:20.563393 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.563372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.568398 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.568371    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hsbjk\""
Jul 07 15:36:20.568536 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.568381    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 15:36:20.569499 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.569482    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:36:20.570056 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.570041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:36:20.583694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.583670    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"]
Jul 07 15:36:20.622386 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.622358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:20.640557 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjcq\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-kube-api-access-gsjcq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640640 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640640 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640640 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c18eae91-3bb2-498e-97a4-7337ae5a6012-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.640888 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.640768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.741873 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.741836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.741873 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.741871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742152 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.741893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742152 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742309 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742295    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742360 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742415 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742470 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjcq\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-kube-api-access-gsjcq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.742815 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.742790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.743047 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.743011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.743047 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.743042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.743248 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.743226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c18eae91-3bb2-498e-97a4-7337ae5a6012-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.743753 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.743732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c18eae91-3bb2-498e-97a4-7337ae5a6012-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.745241 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.745218    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.745362 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.745346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.779410 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.779388    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjcq\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-kube-api-access-gsjcq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.794240 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.794217    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c18eae91-3bb2-498e-97a4-7337ae5a6012-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hl5rd\" (UID: \"c18eae91-3bb2-498e-97a4-7337ae5a6012\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:20.873458 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:20.873384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:21.079111 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:36:21.079060    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18eae91_3bb2_498e_97a4_7337ae5a6012.slice/crio-a425e9ff013589bffaeab27ea1ab58f599cd3c815e3d5ac353ce84f2c17f4d76 WatchSource:0}: Error finding container a425e9ff013589bffaeab27ea1ab58f599cd3c815e3d5ac353ce84f2c17f4d76: Status 404 returned error can't find the container with id a425e9ff013589bffaeab27ea1ab58f599cd3c815e3d5ac353ce84f2c17f4d76
Jul 07 15:36:21.081416 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:21.081393    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"]
Jul 07 15:36:21.112430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:21.112391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:21.396390 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:21.396352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:22.071868 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.071829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd" event={"ID":"c18eae91-3bb2-498e-97a4-7337ae5a6012","Type":"ContainerStarted","Data":"a425e9ff013589bffaeab27ea1ab58f599cd3c815e3d5ac353ce84f2c17f4d76"}
Jul 07 15:36:22.741725 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.741678    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"]
Jul 07 15:36:22.744340 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.744319    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.749171 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.749143    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 15:36:22.749336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.749142    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 15:36:22.749457 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.749441    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 15:36:22.750360 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.750338    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jqfzg\""
Jul 07 15:36:22.750466 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.750367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:36:22.750466 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.750455    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 15:36:22.757740 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.757721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"]
Jul 07 15:36:22.863718 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.863680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.863899 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.863722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.863899 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.863773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psv8w\" (UniqueName: \"kubernetes.io/projected/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-kube-api-access-psv8w\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.863899 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.863851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.964539 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.964497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psv8w\" (UniqueName: \"kubernetes.io/projected/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-kube-api-access-psv8w\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.964747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.964586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.964747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.964676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.964747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.964693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.965604 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.965581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.967687 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.967659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.967687 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.967681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:22.993617 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:22.993551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psv8w\" (UniqueName: \"kubernetes.io/projected/63fe93e3-e9e9-4468-9dde-cb21cb7860cd-kube-api-access-psv8w\") pod \"lws-controller-manager-7fb8c6bffd-vqwxr\" (UID: \"63fe93e3-e9e9-4468-9dde-cb21cb7860cd\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:23.056453 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:23.056415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:23.239512 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:36:23.239468    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fe93e3_e9e9_4468_9dde_cb21cb7860cd.slice/crio-253d6c1573ef2fc3b662b55e05336568bfb60c9ef984c491020d0bc9b460b6ea WatchSource:0}: Error finding container 253d6c1573ef2fc3b662b55e05336568bfb60c9ef984c491020d0bc9b460b6ea: Status 404 returned error can't find the container with id 253d6c1573ef2fc3b662b55e05336568bfb60c9ef984c491020d0bc9b460b6ea
Jul 07 15:36:23.240098 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:23.240053    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"]
Jul 07 15:36:24.085172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:24.085107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr" event={"ID":"63fe93e3-e9e9-4468-9dde-cb21cb7860cd","Type":"ContainerStarted","Data":"253d6c1573ef2fc3b662b55e05336568bfb60c9ef984c491020d0bc9b460b6ea"}
Jul 07 15:36:25.762616 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.762562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:25.897049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.897010    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:25.910987 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.910955    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"]
Jul 07 15:36:25.922206 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.922183    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"]
Jul 07 15:36:25.922331 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.922305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:25.925414 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.925392    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 15:36:25.925551 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.925402    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-r4p88\""
Jul 07 15:36:25.926671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.926650    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:25.934583 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.934116    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 15:36:25.934583 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.934365    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-znwq9\""
Jul 07 15:36:25.936142 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.936119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"]
Jul 07 15:36:25.960878 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:25.960854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"]
Jul 07 15:36:26.024679 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.024601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:26.099612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.094492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/676cf42b-ee17-402f-a7a0-5472686f2f55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.099612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.094647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-762zd\" (UniqueName: \"kubernetes.io/projected/3665dfd5-7a1f-43b3-a395-db380544ecb4-kube-api-access-762zd\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.099612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.094689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxfrq\" (UniqueName: \"kubernetes.io/projected/676cf42b-ee17-402f-a7a0-5472686f2f55-kube-api-access-jxfrq\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.099612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.094744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3665dfd5-7a1f-43b3-a395-db380544ecb4-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.107017 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.106978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:26.196058 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.196023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3665dfd5-7a1f-43b3-a395-db380544ecb4-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.196271 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.196166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/676cf42b-ee17-402f-a7a0-5472686f2f55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.196271 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.196205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-762zd\" (UniqueName: \"kubernetes.io/projected/3665dfd5-7a1f-43b3-a395-db380544ecb4-kube-api-access-762zd\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.196271 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.196243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxfrq\" (UniqueName: \"kubernetes.io/projected/676cf42b-ee17-402f-a7a0-5472686f2f55-kube-api-access-jxfrq\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.199520 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.199494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3665dfd5-7a1f-43b3-a395-db380544ecb4-cert\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.199644 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.199494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/676cf42b-ee17-402f-a7a0-5472686f2f55-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.214976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.214949    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-762zd\" (UniqueName: \"kubernetes.io/projected/3665dfd5-7a1f-43b3-a395-db380544ecb4-kube-api-access-762zd\") pod \"kserve-controller-manager-d6f4b65b8-zxrxw\" (UID: \"3665dfd5-7a1f-43b3-a395-db380544ecb4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.216250 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.216226    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxfrq\" (UniqueName: \"kubernetes.io/projected/676cf42b-ee17-402f-a7a0-5472686f2f55-kube-api-access-jxfrq\") pod \"llmisvc-controller-manager-777c6bd7d5-6j5bm\" (UID: \"676cf42b-ee17-402f-a7a0-5472686f2f55\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.232038 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.232003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:26.239093 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.238893    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:26.246160 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.246125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:26.394880 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.394831    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:36:26.395130 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.395110    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:36:26.395186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.395164    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:36:26.554541 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.554511    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"]
Jul 07 15:36:26.561375 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:36:26.561305    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3665dfd5_7a1f_43b3_a395_db380544ecb4.slice/crio-8507867bf608bfa305a5e5e1d5fc3712110ef8bea5619a4c8365c7ff5048e463 WatchSource:0}: Error finding container 8507867bf608bfa305a5e5e1d5fc3712110ef8bea5619a4c8365c7ff5048e463: Status 404 returned error can't find the container with id 8507867bf608bfa305a5e5e1d5fc3712110ef8bea5619a4c8365c7ff5048e463
Jul 07 15:36:26.579315 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.579286    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"]
Jul 07 15:36:26.582669 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:36:26.582640    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod676cf42b_ee17_402f_a7a0_5472686f2f55.slice/crio-3ac904264e1a7eeec2acd1ebad36748381fca2b293cd1db60412d19ea7cc92af WatchSource:0}: Error finding container 3ac904264e1a7eeec2acd1ebad36748381fca2b293cd1db60412d19ea7cc92af: Status 404 returned error can't find the container with id 3ac904264e1a7eeec2acd1ebad36748381fca2b293cd1db60412d19ea7cc92af
Jul 07 15:36:26.809459 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:26.809422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:36:27.102023 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.101923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd" event={"ID":"c18eae91-3bb2-498e-97a4-7337ae5a6012","Type":"ContainerStarted","Data":"b9965038543751630ce60c312b979c2a93d03241c4cbfb22f31bdd69095066f9"}
Jul 07 15:36:27.103319 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.103295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr" event={"ID":"63fe93e3-e9e9-4468-9dde-cb21cb7860cd","Type":"ContainerStarted","Data":"137883ce345481f6d3cb65dc5caef637ccbd1bb184abfab62b01b47141d296c1"}
Jul 07 15:36:27.103437 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.103348    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:27.104402 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.104379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw" event={"ID":"3665dfd5-7a1f-43b3-a395-db380544ecb4","Type":"ContainerStarted","Data":"8507867bf608bfa305a5e5e1d5fc3712110ef8bea5619a4c8365c7ff5048e463"}
Jul 07 15:36:27.105404 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.105385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm" event={"ID":"676cf42b-ee17-402f-a7a0-5472686f2f55","Type":"ContainerStarted","Data":"3ac904264e1a7eeec2acd1ebad36748381fca2b293cd1db60412d19ea7cc92af"}
Jul 07 15:36:27.139398 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.139347    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd" podStartSLOduration=1.825853685 podStartE2EDuration="7.139328502s" totalImagesPullingTime="5.313474817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:27.137323272 +0000 UTC m=+383.161520555" watchObservedRunningTime="2026-07-07 15:36:27.139328502 +0000 UTC m=+383.163525772"
Jul 07 15:36:27.163409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.163368    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr" podStartSLOduration=1.9393273290000002 podStartE2EDuration="5.163354939s" totalImagesPullingTime="3.22402761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:27.162452567 +0000 UTC m=+383.186649836" watchObservedRunningTime="2026-07-07 15:36:27.163354939 +0000 UTC m=+383.187552209"
Jul 07 15:36:27.874006 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.873971    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:27.879871 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:27.879844    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:28.110219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:28.110187    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:28.111162 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:28.111141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hl5rd"
Jul 07 15:36:30.124833 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:30.124789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw" event={"ID":"3665dfd5-7a1f-43b3-a395-db380544ecb4","Type":"ContainerStarted","Data":"07dcf0f44560025825538f7e3507e14f49ca9ecdcd4e82717d7f1585b5434df3"}
Jul 07 15:36:30.125273 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:30.124888    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:36:30.126344 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:30.126320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm" event={"ID":"676cf42b-ee17-402f-a7a0-5472686f2f55","Type":"ContainerStarted","Data":"e7cf7ace8ebf2cbe1fef8fc3bd37d5c2d12c8f081e0c28ea650872a7258e8e22"}
Jul 07 15:36:30.126532 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:30.126513    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:36:30.150169 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:30.150121    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw" podStartSLOduration=1.799530635 podStartE2EDuration="5.150107896s" totalImagesPullingTime="3.350577261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:30.148892382 +0000 UTC m=+386.173089652" watchObservedRunningTime="2026-07-07 15:36:30.150107896 +0000 UTC m=+386.174305165"
Jul 07 15:36:38.112782 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:38.112746    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-vqwxr"
Jul 07 15:36:38.138686 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:36:38.138632    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm" podStartSLOduration=9.806071429 podStartE2EDuration="13.13861546s" totalImagesPullingTime="3.332544031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:30.188022444 +0000 UTC m=+386.212219714" watchObservedRunningTime="2026-07-07 15:36:38.13861546 +0000 UTC m=+394.162812730"
Jul 07 15:37:01.132331 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:01.132299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6j5bm"
Jul 07 15:37:01.135438 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:01.135417    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zxrxw"
Jul 07 15:37:06.116492 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:06.116458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:06.213781 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:06.213747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:08.028228 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:08.028198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:08.171245 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:08.171210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:13.167322 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:13.167293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:13.279989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:13.279957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:13.500717 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:13.500683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:41.327447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:41.327360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:45.311840 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:45.311804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:50.730964 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:50.730925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:51.176307 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:51.176228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:52.353219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.353180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:52.933369 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.933339    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"]
Jul 07 15:37:52.935849 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.935829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:52.938795 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.938776    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:37:52.938873 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.938779    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:37:52.939861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.939845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pdgkt\""
Jul 07 15:37:52.955324 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:52.955299    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"]
Jul 07 15:37:53.046176 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.046143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bb6c\" (UniqueName: \"kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c\") pod \"limitador-operator-controller-manager-859d7b78bd-gd665\" (UID: \"e4aa7471-4b18-4d64-b404-1dd7952cacc5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:53.147491 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.147457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bb6c\" (UniqueName: \"kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c\") pod \"limitador-operator-controller-manager-859d7b78bd-gd665\" (UID: \"e4aa7471-4b18-4d64-b404-1dd7952cacc5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:53.162558 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.162534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bb6c\" (UniqueName: \"kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c\") pod \"limitador-operator-controller-manager-859d7b78bd-gd665\" (UID: \"e4aa7471-4b18-4d64-b404-1dd7952cacc5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:53.245513 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.245484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:53.410129 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.410101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"]
Jul 07 15:37:53.410747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.410722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:53.413240 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:37:53.413208    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4aa7471_4b18_4d64_b404_1dd7952cacc5.slice/crio-07f91e8c3fed462f82a16bd69a65055166b00a5b5ca69bd171671b3d7e7bbfb0 WatchSource:0}: Error finding container 07f91e8c3fed462f82a16bd69a65055166b00a5b5ca69bd171671b3d7e7bbfb0: Status 404 returned error can't find the container with id 07f91e8c3fed462f82a16bd69a65055166b00a5b5ca69bd171671b3d7e7bbfb0
Jul 07 15:37:53.471389 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:53.471355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665" event={"ID":"e4aa7471-4b18-4d64-b404-1dd7952cacc5","Type":"ContainerStarted","Data":"07f91e8c3fed462f82a16bd69a65055166b00a5b5ca69bd171671b3d7e7bbfb0"}
Jul 07 15:37:54.016584 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:54.016551    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:54.176581 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:54.176549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:56.485660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:56.485626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665" event={"ID":"e4aa7471-4b18-4d64-b404-1dd7952cacc5","Type":"ContainerStarted","Data":"a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406"}
Jul 07 15:37:56.486098 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:56.485764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:37:56.520050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:56.519994    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665" podStartSLOduration=2.428810657 podStartE2EDuration="4.519981367s" totalImagesPullingTime="2.09117071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:56.519213639 +0000 UTC m=+472.543410910" watchObservedRunningTime="2026-07-07 15:37:56.519981367 +0000 UTC m=+472.544178637"
Jul 07 15:37:56.569557 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:56.569520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:58.767454 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:58.767426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:37:58.870868 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:37:58.870833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:00.535949 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:00.535912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:01.081010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:01.080972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:02.612011 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:02.611976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:02.791265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:02.791237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:07.494085 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:07.494041    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:09.277152 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:09.277119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:09.394670 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:09.394636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:11.003242 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.003208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:11.101138 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.101111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:11.291435 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.291363    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"]
Jul 07 15:38:11.291582 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.291534    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" containerName="manager" containerID="cri-o://a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406" gracePeriod=2
Jul 07 15:38:11.294388 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.294341    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.295318 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.295292    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"]
Jul 07 15:38:11.329538 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.329507    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"]
Jul 07 15:38:11.329991 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.329977    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" containerName="manager"
Jul 07 15:38:11.330031 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.329995    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" containerName="manager"
Jul 07 15:38:11.330118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.330105    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" containerName="manager"
Jul 07 15:38:11.334931 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.334911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:11.337333 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.337299    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.350433 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.347302    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"]
Jul 07 15:38:11.411554 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.411530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx7m5\" (UniqueName: \"kubernetes.io/projected/7caa282c-fc6f-40fd-9cea-b2c294b9a416-kube-api-access-bx7m5\") pod \"limitador-operator-controller-manager-859d7b78bd-wvkln\" (UID: \"7caa282c-fc6f-40fd-9cea-b2c294b9a416\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:11.512612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.512581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7m5\" (UniqueName: \"kubernetes.io/projected/7caa282c-fc6f-40fd-9cea-b2c294b9a416-kube-api-access-bx7m5\") pod \"limitador-operator-controller-manager-859d7b78bd-wvkln\" (UID: \"7caa282c-fc6f-40fd-9cea-b2c294b9a416\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:11.524110 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.524049    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7m5\" (UniqueName: \"kubernetes.io/projected/7caa282c-fc6f-40fd-9cea-b2c294b9a416-kube-api-access-bx7m5\") pod \"limitador-operator-controller-manager-859d7b78bd-wvkln\" (UID: \"7caa282c-fc6f-40fd-9cea-b2c294b9a416\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:11.539506 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.539485    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.541569 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.541527    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.553166 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.553141    2573 generic.go:356] "Generic (PLEG): container finished" podID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" containerID="a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406" exitCode=0
Jul 07 15:38:11.553248 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.553185    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.554430 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.553196    2573 scope.go:117] "RemoveContainer" containerID="a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406"
Jul 07 15:38:11.555523 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.555500    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:11.562810 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.562794    2573 scope.go:117] "RemoveContainer" containerID="a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406"
Jul 07 15:38:11.563088 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.563045    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406\": container with ID starting with a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406 not found: ID does not exist" containerID="a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406"
Jul 07 15:38:11.563154 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.563101    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406"} err="failed to get container status \"a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406\": rpc error: code = NotFound desc = could not find container \"a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406\": container with ID starting with a35244f640a12f659f1571b29a5d99fac591e2654233aa479ec67e1e01819406 not found: ID does not exist"
Jul 07 15:38:11.612977 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.612947    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bb6c\" (UniqueName: \"kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c\") pod \"e4aa7471-4b18-4d64-b404-1dd7952cacc5\" (UID: \"e4aa7471-4b18-4d64-b404-1dd7952cacc5\") "
Jul 07 15:38:11.615128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.615103    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c" (OuterVolumeSpecName: "kube-api-access-5bb6c") pod "e4aa7471-4b18-4d64-b404-1dd7952cacc5" (UID: "e4aa7471-4b18-4d64-b404-1dd7952cacc5"). InnerVolumeSpecName "kube-api-access-5bb6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:11.666710 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.666681    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:11.714146 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.714098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bb6c\" (UniqueName: \"kubernetes.io/projected/e4aa7471-4b18-4d64-b404-1dd7952cacc5-kube-api-access-5bb6c\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.801306 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:11.801238    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"]
Jul 07 15:38:11.804301 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:38:11.804275    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caa282c_fc6f_40fd_9cea_b2c294b9a416.slice/crio-11800edbf33565f51564eebb4fafc1be943ff2d915573275119e944465b0a47e WatchSource:0}: Error finding container 11800edbf33565f51564eebb4fafc1be943ff2d915573275119e944465b0a47e: Status 404 returned error can't find the container with id 11800edbf33565f51564eebb4fafc1be943ff2d915573275119e944465b0a47e
Jul 07 15:38:11.863220 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:11.863188    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:12.558576 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:12.558540    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln" event={"ID":"7caa282c-fc6f-40fd-9cea-b2c294b9a416","Type":"ContainerStarted","Data":"600609be0297ffcbba25bba628f8605b8e60cf5d4c0bc92021b2e5d37281f372"}
Jul 07 15:38:12.559050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:12.558609    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:12.559050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:12.558635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln" event={"ID":"7caa282c-fc6f-40fd-9cea-b2c294b9a416","Type":"ContainerStarted","Data":"11800edbf33565f51564eebb4fafc1be943ff2d915573275119e944465b0a47e"}
Jul 07 15:38:12.561264 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:38:12.561240    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gd665\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gd665"
Jul 07 15:38:12.597209 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:12.597173    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4aa7471-4b18-4d64-b404-1dd7952cacc5" path="/var/lib/kubelet/pods/e4aa7471-4b18-4d64-b404-1dd7952cacc5/volumes"
Jul 07 15:38:12.616222 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:12.616147    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln" podStartSLOduration=1.616128411 podStartE2EDuration="1.616128411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:12.615102893 +0000 UTC m=+488.639300154" watchObservedRunningTime="2026-07-07 15:38:12.616128411 +0000 UTC m=+488.640325681"
Jul 07 15:38:14.060409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:14.060376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:14.165101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:14.165030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:14.265244 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:14.265211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:16.784700 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:16.784671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:16.887658 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:16.887620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:20.320718 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:20.320681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:20.421431 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:20.421403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:23.566381 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:23.566350    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wvkln"
Jul 07 15:38:27.401416 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:27.401377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:27.490666 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:27.490629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:32.181565 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:32.181531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:32.278779 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:32.278749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:40.186128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.186096    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"]
Jul 07 15:38:40.189598 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.189578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.193095 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.193055    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5v6zg\""
Jul 07 15:38:40.207248 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.207224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"]
Jul 07 15:38:40.219020 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.218998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:40.252118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252270 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252270 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252270 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd94016d-1de2-4a70-ba03-ae649c278c56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252386 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wl7q\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-kube-api-access-8wl7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252386 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252386 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252386 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.252522 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.252401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd94016d-1de2-4a70-ba03-ae649c278c56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353455 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wl7q\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-kube-api-access-8wl7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353597    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353960 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.353960 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.353873    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.354214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.354153    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.354214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.354178    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.354214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.354200    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.354358 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.354278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd94016d-1de2-4a70-ba03-ae649c278c56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.355955 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.355930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.356214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.356199    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.367170 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.367148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.367301 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.367279    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wl7q\" (UniqueName: \"kubernetes.io/projected/bd94016d-1de2-4a70-ba03-ae649c278c56-kube-api-access-8wl7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-zhqtg\" (UID: \"bd94016d-1de2-4a70-ba03-ae649c278c56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.500694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.500658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:40.638835 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.638778    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"]
Jul 07 15:38:40.641058 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:38:40.641031    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd94016d_1de2_4a70_ba03_ae649c278c56.slice/crio-89ad098677a74b4c34029217acff5fe59f34ec84d986e98622c8050e430a5d9c WatchSource:0}: Error finding container 89ad098677a74b4c34029217acff5fe59f34ec84d986e98622c8050e430a5d9c: Status 404 returned error can't find the container with id 89ad098677a74b4c34029217acff5fe59f34ec84d986e98622c8050e430a5d9c
Jul 07 15:38:40.643019 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.642988    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:38:40.643091 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.643057    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:38:40.643135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.643108    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:38:40.677012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.676988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" event={"ID":"bd94016d-1de2-4a70-ba03-ae649c278c56","Type":"ContainerStarted","Data":"89ad098677a74b4c34029217acff5fe59f34ec84d986e98622c8050e430a5d9c"}
Jul 07 15:38:40.837363 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:40.837270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:41.688397 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:41.688357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" event={"ID":"bd94016d-1de2-4a70-ba03-ae649c278c56","Type":"ContainerStarted","Data":"b42633e46e4d551dd3dc5b45c677dc829d3ce76bd39445c060be1717d16ed275"}
Jul 07 15:38:41.717082 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:41.717010    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" podStartSLOduration=1.716991522 podStartE2EDuration="1.716991522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:41.715669289 +0000 UTC m=+517.739866559" watchObservedRunningTime="2026-07-07 15:38:41.716991522 +0000 UTC m=+517.741188793"
Jul 07 15:38:42.501528 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:42.501498    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:42.506029 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:42.506008    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:42.693224 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:42.693195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:42.694202 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:42.694182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:38:49.518823 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:49.518775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:49.617685 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:49.617656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:54.052156 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:54.052126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:54.166198 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:54.166163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:54.494251 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:54.494214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:54.935044 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:54.934945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:55.111722 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.111681    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:38:55.114467 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.114446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:38:55.115848 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.115825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:38:55.117291 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.117274    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntfdw\""
Jul 07 15:38:55.123188 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.123169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:38:55.287444 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.287414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dl5h\" (UniqueName: \"kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h\") pod \"authorino-75d556bd77-wng5k\" (UID: \"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486\") " pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:38:55.387862 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.387829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dl5h\" (UniqueName: \"kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h\") pod \"authorino-75d556bd77-wng5k\" (UID: \"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486\") " pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:38:55.397397 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.397368    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dl5h\" (UniqueName: \"kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h\") pod \"authorino-75d556bd77-wng5k\" (UID: \"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486\") " pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:38:55.424291 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.424253    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:38:55.555935 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.555911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:38:55.557970 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:38:55.557945    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3f4ba4f_3cfc_4b2a_9859_d1ce2c367486.slice/crio-f4d9b08df1200ec18a253ae5a7142e7809a3f3a1a63275d76a5bfcb6694cb92a WatchSource:0}: Error finding container f4d9b08df1200ec18a253ae5a7142e7809a3f3a1a63275d76a5bfcb6694cb92a: Status 404 returned error can't find the container with id f4d9b08df1200ec18a253ae5a7142e7809a3f3a1a63275d76a5bfcb6694cb92a
Jul 07 15:38:55.756298 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:55.756257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wng5k" event={"ID":"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486","Type":"ContainerStarted","Data":"f4d9b08df1200ec18a253ae5a7142e7809a3f3a1a63275d76a5bfcb6694cb92a"}
Jul 07 15:38:59.777246 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:59.777205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wng5k" event={"ID":"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486","Type":"ContainerStarted","Data":"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"}
Jul 07 15:38:59.795646 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:38:59.795592    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wng5k" podStartSLOduration=1.476689117 podStartE2EDuration="4.795576957s" totalImagesPullingTime="3.31888784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:59.795270566 +0000 UTC m=+535.819467835" watchObservedRunningTime="2026-07-07 15:38:59.795576957 +0000 UTC m=+535.819774248"
Jul 07 15:39:14.793809 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:14.793772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:20.050560 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:20.050527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:21.003616 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:21.003585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:25.451669 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:25.451629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:27.211412 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.211378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:27.401013 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.400983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:27.471024 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.470946    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:27.474209 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.474193    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:27.483992 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.483972    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:27.562529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.562481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwnp\" (UniqueName: \"kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp\") pod \"authorino-5d4b67c446-w5nm6\" (UID: \"53fa409d-7be6-438c-8bd4-1a7ed5be19d2\") " pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:27.663869 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.663827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvwnp\" (UniqueName: \"kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp\") pod \"authorino-5d4b67c446-w5nm6\" (UID: \"53fa409d-7be6-438c-8bd4-1a7ed5be19d2\") " pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:27.673710 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.673681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvwnp\" (UniqueName: \"kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp\") pod \"authorino-5d4b67c446-w5nm6\" (UID: \"53fa409d-7be6-438c-8bd4-1a7ed5be19d2\") " pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:27.734829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.734796    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:27.735055 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.735044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:27.763440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.763411    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9bbcd48f4-9rfrv"]
Jul 07 15:39:27.766396 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.766380    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:27.775820 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.775795    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9bbcd48f4-9rfrv"]
Jul 07 15:39:27.845002 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.844971    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9bbcd48f4-9rfrv"]
Jul 07 15:39:27.845370 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:39:27.845343    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8t7dx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-9bbcd48f4-9rfrv" podUID="9bb0d092-bdcd-4b36-a24d-8bc34cc4324c"
Jul 07 15:39:27.865705 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.865670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7dx\" (UniqueName: \"kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx\") pod \"authorino-9bbcd48f4-9rfrv\" (UID: \"9bb0d092-bdcd-4b36-a24d-8bc34cc4324c\") " pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:27.880708 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.880687    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:27.883393 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:39:27.883363    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53fa409d_7be6_438c_8bd4_1a7ed5be19d2.slice/crio-a89dffc53162fceac35c1bed9349b6d000d0950c9cc3194bf16464381e6fc73f WatchSource:0}: Error finding container a89dffc53162fceac35c1bed9349b6d000d0950c9cc3194bf16464381e6fc73f: Status 404 returned error can't find the container with id a89dffc53162fceac35c1bed9349b6d000d0950c9cc3194bf16464381e6fc73f
Jul 07 15:39:27.883634 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.883616    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:39:27.890603 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.890583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:27.895374 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.895352    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 15:39:27.899216 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.898312    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:39:27.907227 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.907196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" event={"ID":"53fa409d-7be6-438c-8bd4-1a7ed5be19d2","Type":"ContainerStarted","Data":"a89dffc53162fceac35c1bed9349b6d000d0950c9cc3194bf16464381e6fc73f"}
Jul 07 15:39:27.907320 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.907230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:27.912858 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.912838    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:27.966557 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.966527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4z7\" (UniqueName: \"kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:27.966734 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.966566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7dx\" (UniqueName: \"kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx\") pod \"authorino-9bbcd48f4-9rfrv\" (UID: \"9bb0d092-bdcd-4b36-a24d-8bc34cc4324c\") " pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:27.966734 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.966623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:27.976133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:27.976105    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7dx\" (UniqueName: \"kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx\") pod \"authorino-9bbcd48f4-9rfrv\" (UID: \"9bb0d092-bdcd-4b36-a24d-8bc34cc4324c\") " pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:28.068196 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.068101    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t7dx\" (UniqueName: \"kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx\") pod \"9bb0d092-bdcd-4b36-a24d-8bc34cc4324c\" (UID: \"9bb0d092-bdcd-4b36-a24d-8bc34cc4324c\") "
Jul 07 15:39:28.068368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.068264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4z7\" (UniqueName: \"kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:28.068368 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.068304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:28.070417 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.070386    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx" (OuterVolumeSpecName: "kube-api-access-8t7dx") pod "9bb0d092-bdcd-4b36-a24d-8bc34cc4324c" (UID: "9bb0d092-bdcd-4b36-a24d-8bc34cc4324c"). InnerVolumeSpecName "kube-api-access-8t7dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:39:28.070735 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.070718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:28.078209 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.078183    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4z7\" (UniqueName: \"kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7\") pod \"authorino-858c4d9fbb-6mmd9\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") " pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:28.168881 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.168855    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t7dx\" (UniqueName: \"kubernetes.io/projected/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c-kube-api-access-8t7dx\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:39:28.206786 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.206759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:39:28.342439 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.342161    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:39:28.344328 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:39:28.344300    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b482665_51b7_4d3b_813a_f251edc0c33e.slice/crio-e1616ef09dddb38c012441243a13502ed5952b41f36e505132f2fdf3e3781302 WatchSource:0}: Error finding container e1616ef09dddb38c012441243a13502ed5952b41f36e505132f2fdf3e3781302: Status 404 returned error can't find the container with id e1616ef09dddb38c012441243a13502ed5952b41f36e505132f2fdf3e3781302
Jul 07 15:39:28.913048 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.912937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" event={"ID":"53fa409d-7be6-438c-8bd4-1a7ed5be19d2","Type":"ContainerStarted","Data":"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"}
Jul 07 15:39:28.913048 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.913000    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" podUID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" containerName="authorino" containerID="cri-o://7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e" gracePeriod=30
Jul 07 15:39:28.914849 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.914834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9bbcd48f4-9rfrv"
Jul 07 15:39:28.914937 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.914830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" event={"ID":"5b482665-51b7-4d3b-813a-f251edc0c33e","Type":"ContainerStarted","Data":"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"}
Jul 07 15:39:28.914983 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.914935    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" event={"ID":"5b482665-51b7-4d3b-813a-f251edc0c33e","Type":"ContainerStarted","Data":"e1616ef09dddb38c012441243a13502ed5952b41f36e505132f2fdf3e3781302"}
Jul 07 15:39:28.932026 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.931980    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" podStartSLOduration=1.56723297 podStartE2EDuration="1.931967581s" totalImagesPullingTime="364.734611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:28.930511717 +0000 UTC m=+564.954708989" watchObservedRunningTime="2026-07-07 15:39:28.931967581 +0000 UTC m=+564.956164892"
Jul 07 15:39:28.958036 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.957990    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9bbcd48f4-9rfrv"]
Jul 07 15:39:28.960035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.960008    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9bbcd48f4-9rfrv"]
Jul 07 15:39:28.976878 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:28.976830    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" podStartSLOduration=1.6272693299999998 podStartE2EDuration="1.976817463s" totalImagesPullingTime="349.548133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:28.974919498 +0000 UTC m=+564.999116767" watchObservedRunningTime="2026-07-07 15:39:28.976817463 +0000 UTC m=+565.001014732"
Jul 07 15:39:29.008145 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.008113    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:39:29.008352 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.008327    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wng5k" podUID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" containerName="authorino" containerID="cri-o://1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9" gracePeriod=30
Jul 07 15:39:29.255159 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.255131    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:29.262995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.262975    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:39:29.378867 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.378841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvwnp\" (UniqueName: \"kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp\") pod \"53fa409d-7be6-438c-8bd4-1a7ed5be19d2\" (UID: \"53fa409d-7be6-438c-8bd4-1a7ed5be19d2\") "
Jul 07 15:39:29.379254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.378920    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dl5h\" (UniqueName: \"kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h\") pod \"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486\" (UID: \"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486\") "
Jul 07 15:39:29.381135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.381100    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h" (OuterVolumeSpecName: "kube-api-access-8dl5h") pod "b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" (UID: "b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486"). InnerVolumeSpecName "kube-api-access-8dl5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:39:29.381135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.381115    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp" (OuterVolumeSpecName: "kube-api-access-pvwnp") pod "53fa409d-7be6-438c-8bd4-1a7ed5be19d2" (UID: "53fa409d-7be6-438c-8bd4-1a7ed5be19d2"). InnerVolumeSpecName "kube-api-access-pvwnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:39:29.480123 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.480093    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dl5h\" (UniqueName: \"kubernetes.io/projected/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486-kube-api-access-8dl5h\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:39:29.480123 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.480120    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvwnp\" (UniqueName: \"kubernetes.io/projected/53fa409d-7be6-438c-8bd4-1a7ed5be19d2-kube-api-access-pvwnp\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:39:29.920767 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.920674    2573 generic.go:356] "Generic (PLEG): container finished" podID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" containerID="1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9" exitCode=0
Jul 07 15:39:29.920767 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.920717    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wng5k"
Jul 07 15:39:29.920966 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.920763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wng5k" event={"ID":"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486","Type":"ContainerDied","Data":"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"}
Jul 07 15:39:29.920966 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.920807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wng5k" event={"ID":"b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486","Type":"ContainerDied","Data":"f4d9b08df1200ec18a253ae5a7142e7809a3f3a1a63275d76a5bfcb6694cb92a"}
Jul 07 15:39:29.920966 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.920824    2573 scope.go:117] "RemoveContainer" containerID="1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"
Jul 07 15:39:29.922217 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.922192    2573 generic.go:356] "Generic (PLEG): container finished" podID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" containerID="7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e" exitCode=0
Jul 07 15:39:29.922306 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.922237    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5nm6"
Jul 07 15:39:29.922306 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.922286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" event={"ID":"53fa409d-7be6-438c-8bd4-1a7ed5be19d2","Type":"ContainerDied","Data":"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"}
Jul 07 15:39:29.922389 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.922317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5nm6" event={"ID":"53fa409d-7be6-438c-8bd4-1a7ed5be19d2","Type":"ContainerDied","Data":"a89dffc53162fceac35c1bed9349b6d000d0950c9cc3194bf16464381e6fc73f"}
Jul 07 15:39:29.929249 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.929157    2573 scope.go:117] "RemoveContainer" containerID="1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"
Jul 07 15:39:29.929476 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:39:29.929459    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9\": container with ID starting with 1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9 not found: ID does not exist" containerID="1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"
Jul 07 15:39:29.929541 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.929484    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9"} err="failed to get container status \"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9\": rpc error: code = NotFound desc = could not find container \"1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9\": container with ID starting with 1f1033a40b50877186d382fc18cb46fe61180f31f70c862164929a1c9258aad9 not found: ID does not exist"
Jul 07 15:39:29.929541 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.929500    2573 scope.go:117] "RemoveContainer" containerID="7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"
Jul 07 15:39:29.937260 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.937244    2573 scope.go:117] "RemoveContainer" containerID="7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"
Jul 07 15:39:29.937498 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:39:29.937483    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e\": container with ID starting with 7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e not found: ID does not exist" containerID="7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"
Jul 07 15:39:29.937543 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.937504    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e"} err="failed to get container status \"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e\": rpc error: code = NotFound desc = could not find container \"7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e\": container with ID starting with 7279eb534df014cc8783b45e354c253ea6a106892bdbd8c3703894fdefdd266e not found: ID does not exist"
Jul 07 15:39:29.945297 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.945275    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:39:29.949899 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.949878    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wng5k"]
Jul 07 15:39:29.964977 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.964954    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:29.969697 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:29.969673    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5nm6"]
Jul 07 15:39:30.597698 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:30.597656    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" path="/var/lib/kubelet/pods/53fa409d-7be6-438c-8bd4-1a7ed5be19d2/volumes"
Jul 07 15:39:30.598338 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:30.598130    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bb0d092-bdcd-4b36-a24d-8bc34cc4324c" path="/var/lib/kubelet/pods/9bb0d092-bdcd-4b36-a24d-8bc34cc4324c/volumes"
Jul 07 15:39:30.598422 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:30.598406    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" path="/var/lib/kubelet/pods/b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486/volumes"
Jul 07 15:39:33.644364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.644333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:33.752276 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.752247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:33.862573 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.862532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:33.872794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.872765    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:39:33.873125 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873112    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" containerName="authorino"
Jul 07 15:39:33.873172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873127    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" containerName="authorino"
Jul 07 15:39:33.873172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873145    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" containerName="authorino"
Jul 07 15:39:33.873172 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873151    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" containerName="authorino"
Jul 07 15:39:33.873333 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873202    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fa409d-7be6-438c-8bd4-1a7ed5be19d2" containerName="authorino"
Jul 07 15:39:33.873333 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.873211    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f4ba4f-3cfc-4b2a-9859-d1ce2c367486" containerName="authorino"
Jul 07 15:39:33.876341 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.876324    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:33.878802 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.878781    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6lbm\""
Jul 07 15:39:33.878918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.878839    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 15:39:33.878918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.878902    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 15:39:33.886402 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.886382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:39:33.989377 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:33.989354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:34.022648 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.022599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.022806 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.022703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdzf\" (UniqueName: \"kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.123861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.123826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.124033 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.123903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdzf\" (UniqueName: \"kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.126375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.126342    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.133585 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.133564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdzf\" (UniqueName: \"kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf\") pod \"maas-controller-f76876c5d-dvwkf\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") " pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.186023 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.185985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:34.323572 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.323540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:39:34.327060 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:39:34.327034    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27cdde5_3a23_4daf_85a4_5d0603f27cf0.slice/crio-d6154f9d54125488f2ec3cc53a276450d956e0b55552a225fd51ee215df7a9c7 WatchSource:0}: Error finding container d6154f9d54125488f2ec3cc53a276450d956e0b55552a225fd51ee215df7a9c7: Status 404 returned error can't find the container with id d6154f9d54125488f2ec3cc53a276450d956e0b55552a225fd51ee215df7a9c7
Jul 07 15:39:34.948681 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:34.948639    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-dvwkf" event={"ID":"e27cdde5-3a23-4daf-85a4-5d0603f27cf0","Type":"ContainerStarted","Data":"d6154f9d54125488f2ec3cc53a276450d956e0b55552a225fd51ee215df7a9c7"}
Jul 07 15:39:37.079391 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:37.079352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:37.191705 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:37.191675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:39:37.965579 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:37.965544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-dvwkf" event={"ID":"e27cdde5-3a23-4daf-85a4-5d0603f27cf0","Type":"ContainerStarted","Data":"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"}
Jul 07 15:39:37.965788 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:37.965651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:48.975693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:48.975656    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:39:48.996825 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:48.996778    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f76876c5d-dvwkf" podStartSLOduration=13.101650423 podStartE2EDuration="15.996761846s" totalImagesPullingTime="2.895111423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:37.996725623 +0000 UTC m=+574.020922894" watchObservedRunningTime="2026-07-07 15:39:48.996761846 +0000 UTC m=+585.020959116"
Jul 07 15:39:49.530334 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:39:49.530260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:04.441835 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:04.441803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:40:04.446339 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:04.446318    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:40:08.855979 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:08.855939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:09.295141 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.295111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:09.451683 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.451649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:09.785414 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.785346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:09.862922 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.862891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:09.901135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.901097    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2vdph"]
Jul 07 15:40:09.924552 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.924523    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2vdph"]
Jul 07 15:40:09.924714 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.924654    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:09.927640 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:09.927617    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 15:40:10.032607 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.032575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f30ae3ef-146b-4b6c-be65-4469c383cc75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.032784 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.032621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvkdd\" (UniqueName: \"kubernetes.io/projected/f30ae3ef-146b-4b6c-be65-4469c383cc75-kube-api-access-kvkdd\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.133450 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.133368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f30ae3ef-146b-4b6c-be65-4469c383cc75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.133450 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.133407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvkdd\" (UniqueName: \"kubernetes.io/projected/f30ae3ef-146b-4b6c-be65-4469c383cc75-kube-api-access-kvkdd\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.134053 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.134034    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f30ae3ef-146b-4b6c-be65-4469c383cc75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.142612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.142590    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvkdd\" (UniqueName: \"kubernetes.io/projected/f30ae3ef-146b-4b6c-be65-4469c383cc75-kube-api-access-kvkdd\") pod \"payload-pre-processing-7964457696-2vdph\" (UID: \"f30ae3ef-146b-4b6c-be65-4469c383cc75\") " pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.236798 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.236763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:10.408764 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:10.408736    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2vdph"]
Jul 07 15:40:10.411389 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:40:10.411348    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30ae3ef_146b_4b6c_be65_4469c383cc75.slice/crio-178077e939f22af26d5d3342b24110470b798ad430e1933cb783ea2ef54faa28 WatchSource:0}: Error finding container 178077e939f22af26d5d3342b24110470b798ad430e1933cb783ea2ef54faa28: Status 404 returned error can't find the container with id 178077e939f22af26d5d3342b24110470b798ad430e1933cb783ea2ef54faa28
Jul 07 15:40:11.118608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:11.118574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph" event={"ID":"f30ae3ef-146b-4b6c-be65-4469c383cc75","Type":"ContainerStarted","Data":"178077e939f22af26d5d3342b24110470b798ad430e1933cb783ea2ef54faa28"}
Jul 07 15:40:12.124182 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:12.124142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph" event={"ID":"f30ae3ef-146b-4b6c-be65-4469c383cc75","Type":"ContainerStarted","Data":"477277eafa246dc03e7c1373826510e959a1ecf1c52096f7442a1c20bace03ba"}
Jul 07 15:40:12.124651 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:12.124366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:12.164507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:12.161922    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph" podStartSLOduration=1.66968458 podStartE2EDuration="3.161904224s" totalImagesPullingTime="1.492219644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:12.160783591 +0000 UTC m=+608.184980862" watchObservedRunningTime="2026-07-07 15:40:12.161904224 +0000 UTC m=+608.186101496"
Jul 07 15:40:18.156133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.156099    2573 generic.go:356] "Generic (PLEG): container finished" podID="bd94016d-1de2-4a70-ba03-ae649c278c56" containerID="b42633e46e4d551dd3dc5b45c677dc829d3ce76bd39445c060be1717d16ed275" exitCode=0
Jul 07 15:40:18.156561 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.156162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" event={"ID":"bd94016d-1de2-4a70-ba03-ae649c278c56","Type":"ContainerDied","Data":"b42633e46e4d551dd3dc5b45c677dc829d3ce76bd39445c060be1717d16ed275"}
Jul 07 15:40:18.156701 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.156683    2573 scope.go:117] "RemoveContainer" containerID="b42633e46e4d551dd3dc5b45c677dc829d3ce76bd39445c060be1717d16ed275"
Jul 07 15:40:18.157879 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.157847    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:40:18.157979 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.157945    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:40:18.158043 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:18.158025    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:40:19.165211 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:19.165162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" event={"ID":"bd94016d-1de2-4a70-ba03-ae649c278c56","Type":"ContainerStarted","Data":"73a61ddf69d92cce3265c50673aa43130cccf1436fee1964247e4e464472c2f8"}
Jul 07 15:40:19.180745 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:19.180704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:19.501117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:19.501061    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:40:19.501449 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:19.501425    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zhqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 07 15:40:19.501496 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:19.501478    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" podUID="bd94016d-1de2-4a70-ba03-ae649c278c56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 07 15:40:20.501127 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:20.501095    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zhqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 07 15:40:20.501551 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:20.501149    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" podUID="bd94016d-1de2-4a70-ba03-ae649c278c56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 07 15:40:21.501777 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:21.501742    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zhqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 07 15:40:21.502214 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:21.501815    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" podUID="bd94016d-1de2-4a70-ba03-ae649c278c56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 07 15:40:21.948022 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:21.947908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:22.501593 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:22.501556    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zhqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 07 15:40:22.501776 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:22.501613    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg" podUID="bd94016d-1de2-4a70-ba03-ae649c278c56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 07 15:40:23.131092 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.131036    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2vdph"
Jul 07 15:40:23.504988 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.504959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:40:23.505270 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.505251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:40:23.505842 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.505827    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zhqtg"
Jul 07 15:40:23.836622 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.836516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:23.901463 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:23.901428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:33.238693 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.238615    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"]
Jul 07 15:40:33.241185 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.241165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.246503 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.246477    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 15:40:33.246641 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.246557    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6dn84\""
Jul 07 15:40:33.246641 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.246488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 15:40:33.246815 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.246724    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 15:40:33.254056 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.254037    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"]
Jul 07 15:40:33.321188 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.321154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:33.360485 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.360644 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.360644 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clm7n\" (UniqueName: \"kubernetes.io/projected/60d7e738-82a9-4c8a-bf05-d480ef0c6444-kube-api-access-clm7n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.360725 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.360725 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.360725 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.360702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.461995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.461955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.461995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.461997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clm7n\" (UniqueName: \"kubernetes.io/projected/60d7e738-82a9-4c8a-bf05-d480ef0c6444-kube-api-access-clm7n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462477 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462425    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462580 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462553    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.462707 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.462602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.465016 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.464994    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d7e738-82a9-4c8a-bf05-d480ef0c6444-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.465177 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.465162    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d7e738-82a9-4c8a-bf05-d480ef0c6444-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.471846 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.471826    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clm7n\" (UniqueName: \"kubernetes.io/projected/60d7e738-82a9-4c8a-bf05-d480ef0c6444-kube-api-access-clm7n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt\" (UID: \"60d7e738-82a9-4c8a-bf05-d480ef0c6444\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.550992 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.550908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:33.696406 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:33.696349    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"]
Jul 07 15:40:33.699237 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:40:33.699209    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d7e738_82a9_4c8a_bf05_d480ef0c6444.slice/crio-7a3c4d79f498097d34a6e9abe2d2301e1269cb3afc08e6595059ba840f0bafee WatchSource:0}: Error finding container 7a3c4d79f498097d34a6e9abe2d2301e1269cb3afc08e6595059ba840f0bafee: Status 404 returned error can't find the container with id 7a3c4d79f498097d34a6e9abe2d2301e1269cb3afc08e6595059ba840f0bafee
Jul 07 15:40:34.237813 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:34.237741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt" event={"ID":"60d7e738-82a9-4c8a-bf05-d480ef0c6444","Type":"ContainerStarted","Data":"7a3c4d79f498097d34a6e9abe2d2301e1269cb3afc08e6595059ba840f0bafee"}
Jul 07 15:40:35.244278 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:35.244246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt" event={"ID":"60d7e738-82a9-4c8a-bf05-d480ef0c6444","Type":"ContainerStarted","Data":"c73918e0adc55d423bea11cc7116d7ad2b4dddc0172e6f756b52b8626746ab21"}
Jul 07 15:40:35.264885 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:35.264840    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt" podStartSLOduration=1.057234083 podStartE2EDuration="2.264824301s" totalImagesPullingTime="1.207590218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:35.263650537 +0000 UTC m=+631.287847807" watchObservedRunningTime="2026-07-07 15:40:35.264824301 +0000 UTC m=+631.289021570"
Jul 07 15:40:40.063453 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:40.063418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:43.551444 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:43.551413    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:43.551826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:43.551488    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:43.564010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:43.563984    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:44.296756 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:44.296732    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt"
Jul 07 15:40:46.768610 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:46.768575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:40:53.852243 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:40:53.852214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:01.726660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.726632    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"]
Jul 07 15:41:01.729098 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.729055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.731734 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.731713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 15:41:01.742904 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.742881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"]
Jul 07 15:41:01.802033 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.802219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.802219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.802219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ee50a6-58fe-4242-ab3f-06afdabc4811-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.802219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzdk\" (UniqueName: \"kubernetes.io/projected/62ee50a6-58fe-4242-ab3f-06afdabc4811-kube-api-access-4fzdk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.802219 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.802204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.830440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.830404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:01.902626 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.902794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.902794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ee50a6-58fe-4242-ab3f-06afdabc4811-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.902794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzdk\" (UniqueName: \"kubernetes.io/projected/62ee50a6-58fe-4242-ab3f-06afdabc4811-kube-api-access-4fzdk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.902794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.902794 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.902750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.903060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.903025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.903151 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.903137    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.903204 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.903187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.905035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.905013    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ee50a6-58fe-4242-ab3f-06afdabc4811-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.905362 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.905344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ee50a6-58fe-4242-ab3f-06afdabc4811-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:01.911826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:01.911802    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzdk\" (UniqueName: \"kubernetes.io/projected/62ee50a6-58fe-4242-ab3f-06afdabc4811-kube-api-access-4fzdk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pcmcj\" (UID: \"62ee50a6-58fe-4242-ab3f-06afdabc4811\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:02.038770 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:02.038691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:02.177102 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:02.177044    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"]
Jul 07 15:41:02.179643 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:41:02.179615    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ee50a6_58fe_4242_ab3f_06afdabc4811.slice/crio-8ef85584c5382ae55068addbebd6644d09ffe0d01f28259f5a2f8cf347ba0f5b WatchSource:0}: Error finding container 8ef85584c5382ae55068addbebd6644d09ffe0d01f28259f5a2f8cf347ba0f5b: Status 404 returned error can't find the container with id 8ef85584c5382ae55068addbebd6644d09ffe0d01f28259f5a2f8cf347ba0f5b
Jul 07 15:41:02.180992 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:02.180973    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:41:02.367784 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:02.367708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj" event={"ID":"62ee50a6-58fe-4242-ab3f-06afdabc4811","Type":"ContainerStarted","Data":"8ef85584c5382ae55068addbebd6644d09ffe0d01f28259f5a2f8cf347ba0f5b"}
Jul 07 15:41:03.374855 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:03.374818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj" event={"ID":"62ee50a6-58fe-4242-ab3f-06afdabc4811","Type":"ContainerStarted","Data":"4b5f38e512a8890b275db3523775c22cc168e95b5fac47b35296721276fd7127"}
Jul 07 15:41:03.397633 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:03.397576    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj" podStartSLOduration=2.192568791 podStartE2EDuration="2.39755902s" totalImagesPullingTime="204.990229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:03.396504648 +0000 UTC m=+659.420701921" watchObservedRunningTime="2026-07-07 15:41:03.39755902 +0000 UTC m=+659.421756290"
Jul 07 15:41:06.122149 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:06.122112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:06.265050 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:06.265013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:12.039129 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:12.039095    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:12.039505 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:12.039156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:12.051278 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:12.051259    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:12.428706 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:12.428611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pcmcj"
Jul 07 15:41:18.966989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:18.966957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:19.033224 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:19.033180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:20.429375 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:20.429340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:53.180768 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:53.180727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:53.247963 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:53.247938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:54.345382 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:54.345350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:54.461757 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:54.461721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:41:54.707139 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:54.707014    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:41:54.707294 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:54.707230    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" podUID="5b482665-51b7-4d3b-813a-f251edc0c33e" containerName="authorino" containerID="cri-o://35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83" gracePeriod=30
Jul 07 15:41:54.958954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:54.958903    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:41:55.078382 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.078344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert\") pod \"5b482665-51b7-4d3b-813a-f251edc0c33e\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") "
Jul 07 15:41:55.078562 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.078470    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c4z7\" (UniqueName: \"kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7\") pod \"5b482665-51b7-4d3b-813a-f251edc0c33e\" (UID: \"5b482665-51b7-4d3b-813a-f251edc0c33e\") "
Jul 07 15:41:55.080556 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.080523    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7" (OuterVolumeSpecName: "kube-api-access-8c4z7") pod "5b482665-51b7-4d3b-813a-f251edc0c33e" (UID: "5b482665-51b7-4d3b-813a-f251edc0c33e"). InnerVolumeSpecName "kube-api-access-8c4z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:41:55.088817 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.088789    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5b482665-51b7-4d3b-813a-f251edc0c33e" (UID: "5b482665-51b7-4d3b-813a-f251edc0c33e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:41:55.179502 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.179466    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c4z7\" (UniqueName: \"kubernetes.io/projected/5b482665-51b7-4d3b-813a-f251edc0c33e-kube-api-access-8c4z7\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:41:55.179502 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.179494    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b482665-51b7-4d3b-813a-f251edc0c33e-tls-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:41:55.617122 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.617088    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b482665-51b7-4d3b-813a-f251edc0c33e" containerID="35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83" exitCode=0
Jul 07 15:41:55.617525 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.617141    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9"
Jul 07 15:41:55.617525 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.617169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" event={"ID":"5b482665-51b7-4d3b-813a-f251edc0c33e","Type":"ContainerDied","Data":"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"}
Jul 07 15:41:55.617525 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.617213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858c4d9fbb-6mmd9" event={"ID":"5b482665-51b7-4d3b-813a-f251edc0c33e","Type":"ContainerDied","Data":"e1616ef09dddb38c012441243a13502ed5952b41f36e505132f2fdf3e3781302"}
Jul 07 15:41:55.617525 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.617229    2573 scope.go:117] "RemoveContainer" containerID="35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"
Jul 07 15:41:55.625954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.625940    2573 scope.go:117] "RemoveContainer" containerID="35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"
Jul 07 15:41:55.626211 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:41:55.626194    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83\": container with ID starting with 35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83 not found: ID does not exist" containerID="35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"
Jul 07 15:41:55.626302 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.626218    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83"} err="failed to get container status \"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83\": rpc error: code = NotFound desc = could not find container \"35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83\": container with ID starting with 35baaef6fa19c6392b728ab85eba13740e9adaec0f7acff24dcebaf959f30e83 not found: ID does not exist"
Jul 07 15:41:55.647112 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.647082    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:41:55.653369 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:55.653350    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-858c4d9fbb-6mmd9"]
Jul 07 15:41:56.597622 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:41:56.597589    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b482665-51b7-4d3b-813a-f251edc0c33e" path="/var/lib/kubelet/pods/5b482665-51b7-4d3b-813a-f251edc0c33e/volumes"
Jul 07 15:43:06.931882 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:06.931822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:07.032510 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.032473    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:43:07.032755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.032727    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f76876c5d-dvwkf" podUID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" containerName="manager" containerID="cri-o://9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6" gracePeriod=30
Jul 07 15:43:07.276953 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.276927    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:43:07.315283 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.315246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert\") pod \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") "
Jul 07 15:43:07.315447 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.315359    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsdzf\" (UniqueName: \"kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf\") pod \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\" (UID: \"e27cdde5-3a23-4daf-85a4-5d0603f27cf0\") "
Jul 07 15:43:07.317720 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.317689    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e27cdde5-3a23-4daf-85a4-5d0603f27cf0" (UID: "e27cdde5-3a23-4daf-85a4-5d0603f27cf0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:07.317720 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.317707    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf" (OuterVolumeSpecName: "kube-api-access-dsdzf") pod "e27cdde5-3a23-4daf-85a4-5d0603f27cf0" (UID: "e27cdde5-3a23-4daf-85a4-5d0603f27cf0"). InnerVolumeSpecName "kube-api-access-dsdzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:07.416857 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.416812    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsdzf\" (UniqueName: \"kubernetes.io/projected/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-kube-api-access-dsdzf\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.416857 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.416855    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e27cdde5-3a23-4daf-85a4-5d0603f27cf0-webhook-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.939168 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.939134    2573 generic.go:356] "Generic (PLEG): container finished" podID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" containerID="9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6" exitCode=0
Jul 07 15:43:07.939631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.939180    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-dvwkf"
Jul 07 15:43:07.939631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.939225    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-dvwkf" event={"ID":"e27cdde5-3a23-4daf-85a4-5d0603f27cf0","Type":"ContainerDied","Data":"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"}
Jul 07 15:43:07.939631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.939284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-dvwkf" event={"ID":"e27cdde5-3a23-4daf-85a4-5d0603f27cf0","Type":"ContainerDied","Data":"d6154f9d54125488f2ec3cc53a276450d956e0b55552a225fd51ee215df7a9c7"}
Jul 07 15:43:07.939631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.939318    2573 scope.go:117] "RemoveContainer" containerID="9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"
Jul 07 15:43:07.947994 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.947976    2573 scope.go:117] "RemoveContainer" containerID="9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"
Jul 07 15:43:07.948309 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:43:07.948289    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6\": container with ID starting with 9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6 not found: ID does not exist" containerID="9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"
Jul 07 15:43:07.948397 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.948316    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6"} err="failed to get container status \"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6\": rpc error: code = NotFound desc = could not find container \"9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6\": container with ID starting with 9a4d1b7e28872e7acc2e24a16d1584b8e3356dfbcad1131111678fd5431ee3a6 not found: ID does not exist"
Jul 07 15:43:07.967584 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.962388    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:43:07.969747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:07.969723    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f76876c5d-dvwkf"]
Jul 07 15:43:08.597728 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.597696    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" path="/var/lib/kubelet/pods/e27cdde5-3a23-4daf-85a4-5d0603f27cf0/volumes"
Jul 07 15:43:08.725272 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.725236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:08.856432 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856358    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f76876c5d-82g62"]
Jul 07 15:43:08.856742 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856729    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" containerName="manager"
Jul 07 15:43:08.856797 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856744    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" containerName="manager"
Jul 07 15:43:08.856797 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856766    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b482665-51b7-4d3b-813a-f251edc0c33e" containerName="authorino"
Jul 07 15:43:08.856797 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856772    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b482665-51b7-4d3b-813a-f251edc0c33e" containerName="authorino"
Jul 07 15:43:08.856916 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856821    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27cdde5-3a23-4daf-85a4-5d0603f27cf0" containerName="manager"
Jul 07 15:43:08.856916 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.856829    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b482665-51b7-4d3b-813a-f251edc0c33e" containerName="authorino"
Jul 07 15:43:08.859694 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.859674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:08.862199 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.862177    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 15:43:08.862299 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.862178    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6lbm\""
Jul 07 15:43:08.863212 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.863194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 15:43:08.871884 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.871863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f76876c5d-82g62"]
Jul 07 15:43:08.930395 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.930369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7423520e-8be9-4909-bd7f-a1e94e0666cd-webhook-cert\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:08.930538 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:08.930399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psld\" (UniqueName: \"kubernetes.io/projected/7423520e-8be9-4909-bd7f-a1e94e0666cd-kube-api-access-7psld\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.030842 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.030813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7423520e-8be9-4909-bd7f-a1e94e0666cd-webhook-cert\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.030842 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.030842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psld\" (UniqueName: \"kubernetes.io/projected/7423520e-8be9-4909-bd7f-a1e94e0666cd-kube-api-access-7psld\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.033336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.033317    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7423520e-8be9-4909-bd7f-a1e94e0666cd-webhook-cert\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.042364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.042341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psld\" (UniqueName: \"kubernetes.io/projected/7423520e-8be9-4909-bd7f-a1e94e0666cd-kube-api-access-7psld\") pod \"maas-controller-f76876c5d-82g62\" (UID: \"7423520e-8be9-4909-bd7f-a1e94e0666cd\") " pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.169731 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.169652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.304733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.304705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f76876c5d-82g62"]
Jul 07 15:43:09.307144 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:43:09.307116    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7423520e_8be9_4909_bd7f_a1e94e0666cd.slice/crio-c47cedaeae3f122423cf641e354a4f396ecfc4fa721166f8576cbb1c59ceb67e WatchSource:0}: Error finding container c47cedaeae3f122423cf641e354a4f396ecfc4fa721166f8576cbb1c59ceb67e: Status 404 returned error can't find the container with id c47cedaeae3f122423cf641e354a4f396ecfc4fa721166f8576cbb1c59ceb67e
Jul 07 15:43:09.950861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.950774    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-82g62" event={"ID":"7423520e-8be9-4909-bd7f-a1e94e0666cd","Type":"ContainerStarted","Data":"f08d14c664a6e99b224ad10e6812f35aaa9013401d3d0b409b39721fbc52ed35"}
Jul 07 15:43:09.950861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.950831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f76876c5d-82g62" event={"ID":"7423520e-8be9-4909-bd7f-a1e94e0666cd","Type":"ContainerStarted","Data":"c47cedaeae3f122423cf641e354a4f396ecfc4fa721166f8576cbb1c59ceb67e"}
Jul 07 15:43:09.951034 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.950874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:09.974373 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:09.974325    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f76876c5d-82g62" podStartSLOduration=1.605166514 podStartE2EDuration="1.974306892s" totalImagesPullingTime="369.140378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:09.972168406 +0000 UTC m=+785.996365676" watchObservedRunningTime="2026-07-07 15:43:09.974306892 +0000 UTC m=+785.998504164"
Jul 07 15:43:20.961443 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:20.961411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f76876c5d-82g62"
Jul 07 15:43:49.433671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:49.433641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:49.540200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:49.540167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:49.687034 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:49.686941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:55.971612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:55.971578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:56.035810 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:56.035772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:56.176409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:56.176372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:56.290192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:56.290156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:43:56.386602 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:43:56.386573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:02.732456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:44:02.732422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:44:02.924224 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:44:02.924189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:45:00.144584 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.144498    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723985-mp4lp"]
Jul 07 15:45:00.147277 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.147257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:00.149929 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.149911    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:45:00.172968 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.172937    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723985-mp4lp"]
Jul 07 15:45:00.205554 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.205519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjc2\" (UniqueName: \"kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2\") pod \"maas-api-key-cleanup-29723985-mp4lp\" (UID: \"fdb6b012-fecc-40a1-909a-88cccb7981ad\") " pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:00.306148 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.306114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjc2\" (UniqueName: \"kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2\") pod \"maas-api-key-cleanup-29723985-mp4lp\" (UID: \"fdb6b012-fecc-40a1-909a-88cccb7981ad\") " pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:00.316323 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.316294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjc2\" (UniqueName: \"kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2\") pod \"maas-api-key-cleanup-29723985-mp4lp\" (UID: \"fdb6b012-fecc-40a1-909a-88cccb7981ad\") " pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:00.485355 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.485331    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:00.614583 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:00.614561    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723985-mp4lp"]
Jul 07 15:45:00.617081 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:45:00.617038    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb6b012_fecc_40a1_909a_88cccb7981ad.slice/crio-bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06 WatchSource:0}: Error finding container bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06: Status 404 returned error can't find the container with id bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06
Jul 07 15:45:01.462868 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:01.462829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp" event={"ID":"fdb6b012-fecc-40a1-909a-88cccb7981ad","Type":"ContainerStarted","Data":"bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06"}
Jul 07 15:45:04.476101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:04.476057    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:45:04.479496 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:04.479461    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:45:04.479699 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:04.479668    2573 generic.go:356] "Generic (PLEG): container finished" podID="fdb6b012-fecc-40a1-909a-88cccb7981ad" containerID="acceed8f9dec035b66466411b07f5c5969c26cc24b728f0a270e3190229474ec" exitCode=0
Jul 07 15:45:04.479817 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:04.479700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp" event={"ID":"fdb6b012-fecc-40a1-909a-88cccb7981ad","Type":"ContainerDied","Data":"acceed8f9dec035b66466411b07f5c5969c26cc24b728f0a270e3190229474ec"}
Jul 07 15:45:05.614836 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:05.614815    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:05.760408 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:05.760337    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdjc2\" (UniqueName: \"kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2\") pod \"fdb6b012-fecc-40a1-909a-88cccb7981ad\" (UID: \"fdb6b012-fecc-40a1-909a-88cccb7981ad\") "
Jul 07 15:45:05.762556 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:05.762526    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2" (OuterVolumeSpecName: "kube-api-access-gdjc2") pod "fdb6b012-fecc-40a1-909a-88cccb7981ad" (UID: "fdb6b012-fecc-40a1-909a-88cccb7981ad"). InnerVolumeSpecName "kube-api-access-gdjc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:45:05.861747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:05.861712    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdjc2\" (UniqueName: \"kubernetes.io/projected/fdb6b012-fecc-40a1-909a-88cccb7981ad-kube-api-access-gdjc2\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:45:06.490359 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:06.490329    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp"
Jul 07 15:45:06.490359 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:06.490335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723985-mp4lp" event={"ID":"fdb6b012-fecc-40a1-909a-88cccb7981ad","Type":"ContainerDied","Data":"bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06"}
Jul 07 15:45:06.490580 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:06.490403    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfbd94bf9c12a662ea3c78e5f8ef1dd391eddfa3e28d00734d99fa25bcbdab06"
Jul 07 15:45:49.151035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:45:49.151004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:47:00.239657 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:47:00.239573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:47:00.340971 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:47:00.340935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:47:53.931709 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:47:53.931670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:48:14.534207 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:48:14.534124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:48:14.609043 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:48:14.609006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:48:30.865126 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:48:30.865050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:50:04.512177 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:50:04.512149    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:50:04.512683 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:50:04.512631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:50:33.250973 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:50:33.250936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:50:33.353976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:50:33.353940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:51:53.163448 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:51:53.163401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:03.784275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:03.784239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:03.886039 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:03.886008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:03.995883 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:03.995826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:04.526576 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:04.526540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:04.597015 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:04.596984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:14.494907 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:14.494849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:14.601572 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:14.601516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:52:14.669637 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:52:14.669609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:54:51.522435 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:54:51.522398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:01.719551 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:01.719513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:04.541910 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:04.541881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:55:04.544080 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:04.544043    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 15:55:10.668237 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:10.668198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:15.122004 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:15.121970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:18.156422 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:18.156384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:18.276452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:18.276421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:18.643792 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:18.643764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:25.633339 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.633256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:25.731655 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.731618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:25.889118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.889038    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:25.889658 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.889637    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb6b012-fecc-40a1-909a-88cccb7981ad" containerName="cleanup"
Jul 07 15:55:25.889705 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.889664    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb6b012-fecc-40a1-909a-88cccb7981ad" containerName="cleanup"
Jul 07 15:55:25.889761 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.889748    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb6b012-fecc-40a1-909a-88cccb7981ad" containerName="cleanup"
Jul 07 15:55:25.893105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.893088    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:25.896367 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.896337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7975d519-openshift-default-dockercfg-qlq6j\""
Jul 07 15:55:25.930598 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.930573    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:25.935649 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:25.935617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:26.027341 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027341 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027439    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b68sp\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:26.027816 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027816 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.027816 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.027700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129230 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b68sp\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129819 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129819 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129640    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129819 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129704    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129961 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.129961 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.129919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.130101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.130014    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.132151 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.132130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.132267 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.132187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.140507 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.140436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.141319 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.141296    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b68sp\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp\") pod \"e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") " pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.202612 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.202588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:26.347918 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.347894    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:26.350355 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:55:26.350318    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e60e1a2_b2dd_4c6b_94a0_fe0e862280c4.slice/crio-74c36bdb9935702536d5f68da9df9416207be7dde02242d2e48c531d1e72bc52 WatchSource:0}: Error finding container 74c36bdb9935702536d5f68da9df9416207be7dde02242d2e48c531d1e72bc52: Status 404 returned error can't find the container with id 74c36bdb9935702536d5f68da9df9416207be7dde02242d2e48c531d1e72bc52
Jul 07 15:55:26.352339 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.352305    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:26.352400 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.352372    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:26.352435 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:26.352405    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:27.089791 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.089757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:27.192752 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.192714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:27.237688 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.237658    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:27.241197 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.241178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.248325 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.248308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-7975d519-serving-cert\""
Jul 07 15:55:27.248428 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.248383    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:55:27.263151 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.263126    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:27.304414 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.304386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:27.314487 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.314456    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" event={"ID":"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4","Type":"ContainerStarted","Data":"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"}
Jul 07 15:55:27.314610 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.314508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" event={"ID":"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4","Type":"ContainerStarted","Data":"74c36bdb9935702536d5f68da9df9416207be7dde02242d2e48c531d1e72bc52"}
Jul 07 15:55:27.341533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.341461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.341533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.341495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.341533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.341520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n78d\" (UniqueName: \"kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.351305 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.351258    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" podStartSLOduration=2.351241631 podStartE2EDuration="2.351241631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:55:27.349283318 +0000 UTC m=+1523.373480608" watchObservedRunningTime="2026-07-07 15:55:27.351241631 +0000 UTC m=+1523.375438969"
Jul 07 15:55:27.442721 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.442686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n78d\" (UniqueName: \"kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.442919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.442849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.442919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.442878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.443033 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:27.442978    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-7975d519-serving-cert: secret "maas-api-e2e-ait-7975d519-serving-cert" not found
Jul 07 15:55:27.443114 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:27.443049    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls podName:ef76a4b3-569a-437e-8cde-7fe73d70fdcf nodeName:}" failed. No retries permitted until 2026-07-07 15:55:27.943028833 +0000 UTC m=+1523.967226087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls") pod "maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" (UID: "ef76a4b3-569a-437e-8cde-7fe73d70fdcf") : secret "maas-api-e2e-ait-7975d519-serving-cert" not found
Jul 07 15:55:27.443557 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.443537    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.488971 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.488940    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n78d\" (UniqueName: \"kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.584602 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.584566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:27.948202 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.948166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.950908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.950882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") pod \"maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") " pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:27.984428 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:27.984396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:28.089121 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.089087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:28.151440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.151406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:28.203577 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.203480    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:28.210301 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.210268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:28.309522 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.309492    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:28.310782 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:55:28.310757    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef76a4b3_569a_437e_8cde_7fe73d70fdcf.slice/crio-bd99896d07b28024544ba7fb3730163ef547669740f400bca4ea48deaf966db5 WatchSource:0}: Error finding container bd99896d07b28024544ba7fb3730163ef547669740f400bca4ea48deaf966db5: Status 404 returned error can't find the container with id bd99896d07b28024544ba7fb3730163ef547669740f400bca4ea48deaf966db5
Jul 07 15:55:28.312291 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.312275    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:55:28.322571 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.322544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" event={"ID":"ef76a4b3-569a-437e-8cde-7fe73d70fdcf","Type":"ContainerStarted","Data":"bd99896d07b28024544ba7fb3730163ef547669740f400bca4ea48deaf966db5"}
Jul 07 15:55:28.322855 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.322843    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:28.323732 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:28.323714    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:30.286112 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:30.286057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:31.341349 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:31.341307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" event={"ID":"ef76a4b3-569a-437e-8cde-7fe73d70fdcf","Type":"ContainerStarted","Data":"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"}
Jul 07 15:55:31.341785 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:31.341401    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:33.055747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.055708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:33.274479 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.274429    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" podStartSLOduration=4.132200151 podStartE2EDuration="6.274410689s" totalImagesPullingTime="2.142210538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:55:31.377972351 +0000 UTC m=+1527.402169621" watchObservedRunningTime="2026-07-07 15:55:33.274410689 +0000 UTC m=+1529.298607959"
Jul 07 15:55:33.275461 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.275443    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:33.275635 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.275616    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" podUID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" containerName="istio-proxy" containerID="cri-o://697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183" gracePeriod=30
Jul 07 15:55:33.307344 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.307258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:33.444274 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.444241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:33.554688 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.554652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:33.554928 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.554880    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" podUID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" containerName="maas-api" containerID="cri-o://e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b" gracePeriod=30
Jul 07 15:55:33.579329 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.579292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:33.799343 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.799315    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:33.905987 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.905914    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") pod \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") "
Jul 07 15:55:33.906165 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.906003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n78d\" (UniqueName: \"kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d\") pod \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") "
Jul 07 15:55:33.906165 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.906097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca\") pod \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\" (UID: \"ef76a4b3-569a-437e-8cde-7fe73d70fdcf\") "
Jul 07 15:55:33.906486 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.906456    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef76a4b3-569a-437e-8cde-7fe73d70fdcf" (UID: "ef76a4b3-569a-437e-8cde-7fe73d70fdcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:55:33.908077 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.908042    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef76a4b3-569a-437e-8cde-7fe73d70fdcf" (UID: "ef76a4b3-569a-437e-8cde-7fe73d70fdcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:55:33.908203 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:33.908187    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d" (OuterVolumeSpecName: "kube-api-access-9n78d") pod "ef76a4b3-569a-437e-8cde-7fe73d70fdcf" (UID: "ef76a4b3-569a-437e-8cde-7fe73d70fdcf"). InnerVolumeSpecName "kube-api-access-9n78d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:34.007452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.007416    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:34.007452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.007447    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:34.007452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.007457    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n78d\" (UniqueName: \"kubernetes.io/projected/ef76a4b3-569a-437e-8cde-7fe73d70fdcf-kube-api-access-9n78d\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:34.357713 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.357679    2573 generic.go:356] "Generic (PLEG): container finished" podID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" containerID="e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b" exitCode=0
Jul 07 15:55:34.357713 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.357715    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" event={"ID":"ef76a4b3-569a-437e-8cde-7fe73d70fdcf","Type":"ContainerDied","Data":"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"}
Jul 07 15:55:34.358256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.357732    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"
Jul 07 15:55:34.358256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.357756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b" event={"ID":"ef76a4b3-569a-437e-8cde-7fe73d70fdcf","Type":"ContainerDied","Data":"bd99896d07b28024544ba7fb3730163ef547669740f400bca4ea48deaf966db5"}
Jul 07 15:55:34.358256 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.357776    2573 scope.go:117] "RemoveContainer" containerID="e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"
Jul 07 15:55:34.366906 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.366890    2573 scope.go:117] "RemoveContainer" containerID="e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"
Jul 07 15:55:34.367182 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:34.367164    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b\": container with ID starting with e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b not found: ID does not exist" containerID="e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"
Jul 07 15:55:34.367229 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.367189    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b"} err="failed to get container status \"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b\": rpc error: code = NotFound desc = could not find container \"e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b\": container with ID starting with e68c820c79b6d6913093148c1f68c4fde8b95981d73a97848a97a71d8732fd2b not found: ID does not exist"
Jul 07 15:55:34.392233 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.392201    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:34.399060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.399036    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-7975d519-54c6bb6496-f2c9b"]
Jul 07 15:55:34.597842 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.597808    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" path="/var/lib/kubelet/pods/ef76a4b3-569a-437e-8cde-7fe73d70fdcf/volumes"
Jul 07 15:55:34.858257 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:34.858230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:38.530828 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.530802    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:38.654876 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.654797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.654876 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.654849    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.654876 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.654876    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.654952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.654984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b68sp\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655111    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655128 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655121    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:38.655425 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token\") pod \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\" (UID: \"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4\") "
Jul 07 15:55:38.655493 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655428    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.655493 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655468    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:38.655493 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655482    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:38.655631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655498    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:55:38.655631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.655536    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:38.657440 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.657409    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:38.657549 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.657456    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:55:38.657608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.657587    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp" (OuterVolumeSpecName: "kube-api-access-b68sp") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "kube-api-access-b68sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:38.657608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.657587    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" (UID: "5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:38.756955 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.756916    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.756955 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.756955    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.756971    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b68sp\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-kube-api-access-b68sp\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.756985    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.756999    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.757012    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.757024    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:38.757208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:38.757036    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:39.389411 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.389377    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" containerID="697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183" exitCode=0
Jul 07 15:55:39.389619 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.389423    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"
Jul 07 15:55:39.389619 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.389460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" event={"ID":"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4","Type":"ContainerDied","Data":"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"}
Jul 07 15:55:39.389619 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.389511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4" event={"ID":"5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4","Type":"ContainerDied","Data":"74c36bdb9935702536d5f68da9df9416207be7dde02242d2e48c531d1e72bc52"}
Jul 07 15:55:39.389619 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.389534    2573 scope.go:117] "RemoveContainer" containerID="697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"
Jul 07 15:55:39.399008 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.398849    2573 scope.go:117] "RemoveContainer" containerID="697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"
Jul 07 15:55:39.399110 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:39.399091    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183\": container with ID starting with 697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183 not found: ID does not exist" containerID="697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"
Jul 07 15:55:39.399178 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.399119    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183"} err="failed to get container status \"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183\": rpc error: code = NotFound desc = could not find container \"697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183\": container with ID starting with 697161efcdf17a4e1cdcc2982d2ec58de4e0fc414b4d651518a24b6ac87f0183 not found: ID does not exist"
Jul 07 15:55:39.416845 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.416812    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:39.421265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:39.421244    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7975d519-openshift-default-57fcbb7c7c-sf7h4"]
Jul 07 15:55:40.597573 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:40.597542    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" path="/var/lib/kubelet/pods/5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4/volumes"
Jul 07 15:55:41.189887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.189851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:41.286589 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.286559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:41.630683 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.630629    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631289    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" containerName="istio-proxy"
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631311    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" containerName="istio-proxy"
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631345    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" containerName="maas-api"
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631354    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" containerName="maas-api"
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631436    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e60e1a2-b2dd-4c6b-94a0-fe0e862280c4" containerName="istio-proxy"
Jul 07 15:55:41.631726 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.631451    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef76a4b3-569a-437e-8cde-7fe73d70fdcf" containerName="maas-api"
Jul 07 15:55:41.634281 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.634265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.656312 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.656282    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:41.657268 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.657242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eb42f960-openshift-default-dockercfg-fb9w8\""
Jul 07 15:55:41.719636 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.719604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:41.780780 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvcm\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.780951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.780951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.834117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.834060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:41.881650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvcm\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.881919 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882224 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.881919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882224 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.882195    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882335 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.882228    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882335 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.882311    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882407 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.882336    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.882407 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.882398    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.884260 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.884231    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.884443 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.884425    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.894506 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.894482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvcm\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:41.952003 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:41.951973    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token\") pod \"e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") " pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:42.244196 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.244152    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:42.417452 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.417421    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:42.418986 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:55:42.418957    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602fac2e_1328_4e64_86df_661d88e595ac.slice/crio-89dbf7640119444cda06fcc35bdb3565895e4e1ab454bef806843f787fc0ce3b WatchSource:0}: Error finding container 89dbf7640119444cda06fcc35bdb3565895e4e1ab454bef806843f787fc0ce3b: Status 404 returned error can't find the container with id 89dbf7640119444cda06fcc35bdb3565895e4e1ab454bef806843f787fc0ce3b
Jul 07 15:55:42.420974 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.420943    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:42.421038 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.421007    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:42.421094 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.421037    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:55:42.984976 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:42.984934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:43.138414 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.138375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:43.183092 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.183027    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:43.186357 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.186335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.204232 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.204213    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:55:43.210692 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.210674    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-eb42f960-serving-cert\""
Jul 07 15:55:43.224310 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.224289    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:43.277401 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.277326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:43.294605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.294581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.294605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.294612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.294806 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.294652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwxt\" (UniqueName: \"kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.395895 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.395859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krwxt\" (UniqueName: \"kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.396135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.395945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.396135 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.395967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.396743 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.396683    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.398595 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.398576    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.411188 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.411164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" event={"ID":"602fac2e-1328-4e64-86df-661d88e595ac","Type":"ContainerStarted","Data":"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"}
Jul 07 15:55:43.411311 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.411219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" event={"ID":"602fac2e-1328-4e64-86df-661d88e595ac","Type":"ContainerStarted","Data":"89dbf7640119444cda06fcc35bdb3565895e4e1ab454bef806843f787fc0ce3b"}
Jul 07 15:55:43.439427 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.439397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwxt\" (UniqueName: \"kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt\") pod \"maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") " pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.443260 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.443233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:43.495136 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.495092    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" podStartSLOduration=2.495054952 podStartE2EDuration="2.495054952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:55:43.494259393 +0000 UTC m=+1539.518456674" watchObservedRunningTime="2026-07-07 15:55:43.495054952 +0000 UTC m=+1539.519252222"
Jul 07 15:55:43.496410 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.496393    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:43.657001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:43.656941    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:43.659198 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:55:43.659172    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3336b4c3_4dd8_4621_9525_e31467dd6fc8.slice/crio-a03076d92f0dc9e0dde6fd117bbe6c5c488cb87242fc155d271f0f2b05dbb851 WatchSource:0}: Error finding container a03076d92f0dc9e0dde6fd117bbe6c5c488cb87242fc155d271f0f2b05dbb851: Status 404 returned error can't find the container with id a03076d92f0dc9e0dde6fd117bbe6c5c488cb87242fc155d271f0f2b05dbb851
Jul 07 15:55:44.245255 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.245215    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:44.250596 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.250571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:44.390254 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.390157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:44.417748 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.417702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" event={"ID":"3336b4c3-4dd8-4621-9525-e31467dd6fc8","Type":"ContainerStarted","Data":"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"}
Jul 07 15:55:44.417916 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.417768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" event={"ID":"3336b4c3-4dd8-4621-9525-e31467dd6fc8","Type":"ContainerStarted","Data":"a03076d92f0dc9e0dde6fd117bbe6c5c488cb87242fc155d271f0f2b05dbb851"}
Jul 07 15:55:44.418009 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.417915    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:44.418009 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.417943    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:44.419079 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.419041    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:44.467688 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.467613    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" podStartSLOduration=1.084760315 podStartE2EDuration="1.467597196s" totalImagesPullingTime="382.836881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:55:44.466441761 +0000 UTC m=+1540.490639031" watchObservedRunningTime="2026-07-07 15:55:44.467597196 +0000 UTC m=+1540.491794466"
Jul 07 15:55:44.557722 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.557695    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:44.733672 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:44.733629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:48.692864 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:48.692828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:49.410473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.410437    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:49.410675 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.410648    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" podUID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" containerName="maas-api" containerID="cri-o://e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c" gracePeriod=30
Jul 07 15:55:49.415562 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.415540    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:49.427490 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.427469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:49.700016 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.699993    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:49.774091 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.773410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca\") pod \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") "
Jul 07 15:55:49.774091 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.773504    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls\") pod \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") "
Jul 07 15:55:49.774091 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.773555    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krwxt\" (UniqueName: \"kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt\") pod \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\" (UID: \"3336b4c3-4dd8-4621-9525-e31467dd6fc8\") "
Jul 07 15:55:49.774771 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.774563    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3336b4c3-4dd8-4621-9525-e31467dd6fc8" (UID: "3336b4c3-4dd8-4621-9525-e31467dd6fc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:55:49.777737 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.777699    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt" (OuterVolumeSpecName: "kube-api-access-krwxt") pod "3336b4c3-4dd8-4621-9525-e31467dd6fc8" (UID: "3336b4c3-4dd8-4621-9525-e31467dd6fc8"). InnerVolumeSpecName "kube-api-access-krwxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:49.777990 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.777949    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3336b4c3-4dd8-4621-9525-e31467dd6fc8" (UID: "3336b4c3-4dd8-4621-9525-e31467dd6fc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:55:49.874592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.874539    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3336b4c3-4dd8-4621-9525-e31467dd6fc8-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:49.874592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.874586    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krwxt\" (UniqueName: \"kubernetes.io/projected/3336b4c3-4dd8-4621-9525-e31467dd6fc8-kube-api-access-krwxt\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:49.874592 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:49.874601    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3336b4c3-4dd8-4621-9525-e31467dd6fc8-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:50.451225 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.451190    2573 generic.go:356] "Generic (PLEG): container finished" podID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" containerID="e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c" exitCode=0
Jul 07 15:55:50.451533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.451323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" event={"ID":"3336b4c3-4dd8-4621-9525-e31467dd6fc8","Type":"ContainerDied","Data":"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"}
Jul 07 15:55:50.451760 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.451723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f" event={"ID":"3336b4c3-4dd8-4621-9525-e31467dd6fc8","Type":"ContainerDied","Data":"a03076d92f0dc9e0dde6fd117bbe6c5c488cb87242fc155d271f0f2b05dbb851"}
Jul 07 15:55:50.451897 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.451874    2573 scope.go:117] "RemoveContainer" containerID="e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"
Jul 07 15:55:50.452201 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.451397    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"
Jul 07 15:55:50.481779 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.481761    2573 scope.go:117] "RemoveContainer" containerID="e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"
Jul 07 15:55:50.482157 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:50.482125    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c\": container with ID starting with e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c not found: ID does not exist" containerID="e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"
Jul 07 15:55:50.482579 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.482169    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c"} err="failed to get container status \"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c\": rpc error: code = NotFound desc = could not find container \"e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c\": container with ID starting with e42e9be2ee4b2bf3b245bd0b2e9c44912222ca714a4dd3784a1d7ff8bd36cf2c not found: ID does not exist"
Jul 07 15:55:50.514946 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.514921    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:50.520293 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.520274    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb42f960-88bdfdc69-vjs9f"]
Jul 07 15:55:50.598565 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:50.598527    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" path="/var/lib/kubelet/pods/3336b4c3-4dd8-4621-9525-e31467dd6fc8/volumes"
Jul 07 15:55:54.832755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:54.832719    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:54.833218 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:54.832932    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" podUID="602fac2e-1328-4e64-86df-661d88e595ac" containerName="istio-proxy" containerID="cri-o://cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299" gracePeriod=30
Jul 07 15:55:54.849540 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:54.849500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:54.957415 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:54.957378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:55:56.377907 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.377885    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:56.437529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437459    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.437529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437510    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.437755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.437755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437570    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.437755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.437917 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437763    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:56.437917 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.437814    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:56.438669 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.438101    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.438669 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.438607    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.440333 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.439441    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:56.440333 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.439755    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:56.440550 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.440390    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:56.441192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.441169    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:55:56.446227 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.446203    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447160    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbvcm\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm\") pod \"602fac2e-1328-4e64-86df-661d88e595ac\" (UID: \"602fac2e-1328-4e64-86df-661d88e595ac\") "
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447605    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447621    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447636    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602fac2e-1328-4e64-86df-661d88e595ac-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.447727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447649    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.448060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.447665    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.448060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.448021    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.448060 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.448036    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602fac2e-1328-4e64-86df-661d88e595ac-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.448320 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.448292    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:55:56.450245 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.450214    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm" (OuterVolumeSpecName: "kube-api-access-gbvcm") pod "602fac2e-1328-4e64-86df-661d88e595ac" (UID: "602fac2e-1328-4e64-86df-661d88e595ac"). InnerVolumeSpecName "kube-api-access-gbvcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:55:56.490989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.490958    2573 generic.go:356] "Generic (PLEG): container finished" podID="602fac2e-1328-4e64-86df-661d88e595ac" containerID="cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299" exitCode=0
Jul 07 15:55:56.491137 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.491004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" event={"ID":"602fac2e-1328-4e64-86df-661d88e595ac","Type":"ContainerDied","Data":"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"}
Jul 07 15:55:56.491137 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.491055    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"
Jul 07 15:55:56.491265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.491130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz" event={"ID":"602fac2e-1328-4e64-86df-661d88e595ac","Type":"ContainerDied","Data":"89dbf7640119444cda06fcc35bdb3565895e4e1ab454bef806843f787fc0ce3b"}
Jul 07 15:55:56.491265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.491178    2573 scope.go:117] "RemoveContainer" containerID="cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"
Jul 07 15:55:56.501105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.501053    2573 scope.go:117] "RemoveContainer" containerID="cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"
Jul 07 15:55:56.501645 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:55:56.501562    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299\": container with ID starting with cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299 not found: ID does not exist" containerID="cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"
Jul 07 15:55:56.501645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.501601    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299"} err="failed to get container status \"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299\": rpc error: code = NotFound desc = could not find container \"cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299\": container with ID starting with cd22dab37c5ea92e1d9b8f4c508cc84917dfe1e998dd08396feecf5ce2148299 not found: ID does not exist"
Jul 07 15:55:56.534811 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.534782    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:56.545021 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.544995    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eb42f960-openshift-default-655b5bb7bc-n99rz"]
Jul 07 15:55:56.548759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.548736    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602fac2e-1328-4e64-86df-661d88e595ac-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.548820 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.548763    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbvcm\" (UniqueName: \"kubernetes.io/projected/602fac2e-1328-4e64-86df-661d88e595ac-kube-api-access-gbvcm\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:55:56.598475 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:55:56.598442    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602fac2e-1328-4e64-86df-661d88e595ac" path="/var/lib/kubelet/pods/602fac2e-1328-4e64-86df-661d88e595ac/volumes"
Jul 07 15:56:02.032048 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:02.032009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:02.889826 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:02.889794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:03.032263 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.032213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:03.217811 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.217781    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:03.218729 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.218695    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602fac2e-1328-4e64-86df-661d88e595ac" containerName="istio-proxy"
Jul 07 15:56:03.218729 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.218720    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="602fac2e-1328-4e64-86df-661d88e595ac" containerName="istio-proxy"
Jul 07 15:56:03.218914 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.218762    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" containerName="maas-api"
Jul 07 15:56:03.218914 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.218772    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" containerName="maas-api"
Jul 07 15:56:03.219012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.219003    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3336b4c3-4dd8-4621-9525-e31467dd6fc8" containerName="maas-api"
Jul 07 15:56:03.219062 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.219017    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="602fac2e-1328-4e64-86df-661d88e595ac" containerName="istio-proxy"
Jul 07 15:56:03.222925 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.222894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.230297 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.230277    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7817fcef-openshift-default-dockercfg-tp68n\""
Jul 07 15:56:03.285606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.285567    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:03.294251 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.294220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:03.305309 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctt8\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.305650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.305514    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.399759 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.399721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:03.406874 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.406981 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.406981 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.406981 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.406981 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.406982    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407186 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407342 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctt8\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407404 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407404 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407560 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407616 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407559    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.407728 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.407712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.409582 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.409561    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.409719 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.409700    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.419705 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.419684    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.426381 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.426355    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctt8\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8\") pod \"e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") " pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.534883 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.534846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:03.688926 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.688882    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:03.691695 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:56:03.691669    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbee5be_4e59_4f68_b495_8ac7fcc2ec9b.slice/crio-3e04d9b6151f1d634db101b9c22c99e052f40c8c187d2585b27d3e58385e841b WatchSource:0}: Error finding container 3e04d9b6151f1d634db101b9c22c99e052f40c8c187d2585b27d3e58385e841b: Status 404 returned error can't find the container with id 3e04d9b6151f1d634db101b9c22c99e052f40c8c187d2585b27d3e58385e841b
Jul 07 15:56:03.693689 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.693653    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:56:03.693774 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.693730    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:56:03.693774 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:03.693760    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:56:04.476920 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.476881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:04.530786 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.530749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" event={"ID":"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b","Type":"ContainerStarted","Data":"435afb19f2a349cd508e7569e568361b37e145486c7bb2818224ab6a6ef05fff"}
Jul 07 15:56:04.530977 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.530804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" event={"ID":"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b","Type":"ContainerStarted","Data":"3e04d9b6151f1d634db101b9c22c99e052f40c8c187d2585b27d3e58385e841b"}
Jul 07 15:56:04.535119 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.535098    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:04.540311 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.540287    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:04.646221 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.646193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:04.718655 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.718601    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" podStartSLOduration=1.718586904 podStartE2EDuration="1.718586904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:56:04.644953012 +0000 UTC m=+1560.669150281" watchObservedRunningTime="2026-07-07 15:56:04.718586904 +0000 UTC m=+1560.742784172"
Jul 07 15:56:04.731959 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.731889    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:04.737161 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.737140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.744664 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.744646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-7817fcef-serving-cert\""
Jul 07 15:56:04.744664 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.744656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:56:04.765009 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.764990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:04.820690 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.820656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqd9\" (UniqueName: \"kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.820875 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.820753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.820875 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.820782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.821004 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.820899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:04.921495 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.921462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqd9\" (UniqueName: \"kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.921674 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.921527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.921674 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.921557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.922262 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.922244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.923874 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.923843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:04.924284 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.924265    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:04.938034 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:04.938007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqd9\" (UniqueName: \"kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9\") pod \"maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") " pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:05.046967 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:05.046889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:05.234167 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:56:05.234143    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbfe2a1_b582_478b_9be0_caa7305fb518.slice/crio-5413ecc9b9c7c40168ad779d80bb19bda455cb0f88123d844d8211e9197f9e23 WatchSource:0}: Error finding container 5413ecc9b9c7c40168ad779d80bb19bda455cb0f88123d844d8211e9197f9e23: Status 404 returned error can't find the container with id 5413ecc9b9c7c40168ad779d80bb19bda455cb0f88123d844d8211e9197f9e23
Jul 07 15:56:05.239039 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:05.239012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:05.537591 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:05.537557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" event={"ID":"5cbfe2a1-b582-478b-9be0-caa7305fb518","Type":"ContainerStarted","Data":"5413ecc9b9c7c40168ad779d80bb19bda455cb0f88123d844d8211e9197f9e23"}
Jul 07 15:56:05.538049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:05.537746    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:05.538796 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:05.538773    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:06.141013 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.140977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:06.250029 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.249992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:06.543930 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.543888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" event={"ID":"5cbfe2a1-b582-478b-9be0-caa7305fb518","Type":"ContainerStarted","Data":"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"}
Jul 07 15:56:06.544372 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.544040    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:06.626508 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.626458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" podStartSLOduration=2.309823144 podStartE2EDuration="2.626442859s" totalImagesPullingTime="316.619715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:56:06.622974244 +0000 UTC m=+1562.647171514" watchObservedRunningTime="2026-07-07 15:56:06.626442859 +0000 UTC m=+1562.650640129"
Jul 07 15:56:06.765671 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:06.765633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:08.970031 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:08.969981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:09.237217 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.237184    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:09.237393 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.237372    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" podUID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" containerName="istio-proxy" containerID="cri-o://435afb19f2a349cd508e7569e568361b37e145486c7bb2818224ab6a6ef05fff" gracePeriod=30
Jul 07 15:56:09.262205 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.262166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:09.380471 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.380435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:09.823353 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.823313    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:09.823645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.823484    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" podUID="5cbfe2a1-b582-478b-9be0-caa7305fb518" containerName="maas-api" containerID="cri-o://04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1" gracePeriod=30
Jul 07 15:56:09.886024 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:09.885989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:10.129971 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.129949    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:10.278380 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.278338    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls\") pod \"5cbfe2a1-b582-478b-9be0-caa7305fb518\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") "
Jul 07 15:56:10.278574 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.278392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnqd9\" (UniqueName: \"kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9\") pod \"5cbfe2a1-b582-478b-9be0-caa7305fb518\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") "
Jul 07 15:56:10.278574 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.278518    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca\") pod \"5cbfe2a1-b582-478b-9be0-caa7305fb518\" (UID: \"5cbfe2a1-b582-478b-9be0-caa7305fb518\") "
Jul 07 15:56:10.278868 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.278843    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cbfe2a1-b582-478b-9be0-caa7305fb518" (UID: "5cbfe2a1-b582-478b-9be0-caa7305fb518"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:56:10.280695 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.280664    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9" (OuterVolumeSpecName: "kube-api-access-xnqd9") pod "5cbfe2a1-b582-478b-9be0-caa7305fb518" (UID: "5cbfe2a1-b582-478b-9be0-caa7305fb518"). InnerVolumeSpecName "kube-api-access-xnqd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:56:10.280807 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.280694    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cbfe2a1-b582-478b-9be0-caa7305fb518" (UID: "5cbfe2a1-b582-478b-9be0-caa7305fb518"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:56:10.379887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.379797    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnqd9\" (UniqueName: \"kubernetes.io/projected/5cbfe2a1-b582-478b-9be0-caa7305fb518-kube-api-access-xnqd9\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:10.379887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.379830    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbfe2a1-b582-478b-9be0-caa7305fb518-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:10.379887 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.379840    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbfe2a1-b582-478b-9be0-caa7305fb518-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:10.569093 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.569040    2573 generic.go:356] "Generic (PLEG): container finished" podID="5cbfe2a1-b582-478b-9be0-caa7305fb518" containerID="04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1" exitCode=0
Jul 07 15:56:10.569289 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.569173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" event={"ID":"5cbfe2a1-b582-478b-9be0-caa7305fb518","Type":"ContainerDied","Data":"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"}
Jul 07 15:56:10.569289 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.569223    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf" event={"ID":"5cbfe2a1-b582-478b-9be0-caa7305fb518","Type":"ContainerDied","Data":"5413ecc9b9c7c40168ad779d80bb19bda455cb0f88123d844d8211e9197f9e23"}
Jul 07 15:56:10.569289 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.569253    2573 scope.go:117] "RemoveContainer" containerID="04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"
Jul 07 15:56:10.569480 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.569416    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"
Jul 07 15:56:10.584367 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.584349    2573 scope.go:117] "RemoveContainer" containerID="04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"
Jul 07 15:56:10.584645 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:56:10.584623    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1\": container with ID starting with 04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1 not found: ID does not exist" containerID="04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"
Jul 07 15:56:10.584697 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.584655    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1"} err="failed to get container status \"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1\": rpc error: code = NotFound desc = could not find container \"04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1\": container with ID starting with 04fcfbd316eee872485fd5758c4944db5c6fe32a38b4a6046775f3ed818e6ba1 not found: ID does not exist"
Jul 07 15:56:10.605275 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.605251    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:10.615800 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.615778    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-7817fcef-5966dcc499-dh5zf"]
Jul 07 15:56:10.976260 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:10.976228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:12.597336 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:12.597294    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbfe2a1-b582-478b-9be0-caa7305fb518" path="/var/lib/kubelet/pods/5cbfe2a1-b582-478b-9be0-caa7305fb518/volumes"
Jul 07 15:56:15.597814 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.597784    2573 generic.go:356] "Generic (PLEG): container finished" podID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" containerID="435afb19f2a349cd508e7569e568361b37e145486c7bb2818224ab6a6ef05fff" exitCode=0
Jul 07 15:56:15.598209 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.597837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" event={"ID":"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b","Type":"ContainerDied","Data":"435afb19f2a349cd508e7569e568361b37e145486c7bb2818224ab6a6ef05fff"}
Jul 07 15:56:15.696155 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.696043    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:15.728947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.728918    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.728947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.728951    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.728966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.728989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729008    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729060    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729200 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729130    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fctt8\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729506 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert\") pod \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\" (UID: \"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b\") "
Jul 07 15:56:15.729506 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729258    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:56:15.729506 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729362    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:56:15.729732 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729559    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.729732 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729579    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.729732 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729634    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:56:15.729732 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729658    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:56:15.730027 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.729792    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:56:15.731276 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.731254    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:56:15.731605 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.731588    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:56:15.731776 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.731755    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8" (OuterVolumeSpecName: "kube-api-access-fctt8") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "kube-api-access-fctt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:56:15.731838 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.731753    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" (UID: "6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:56:15.830499 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830467    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830499 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830495    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830499 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830504    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830511    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830519    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830526    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:15.830727 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:15.830534    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fctt8\" (UniqueName: \"kubernetes.io/projected/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b-kube-api-access-fctt8\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:56:16.262226 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.262192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:16.369762 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.369733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:16.603733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.603653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq" event={"ID":"6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b","Type":"ContainerDied","Data":"3e04d9b6151f1d634db101b9c22c99e052f40c8c187d2585b27d3e58385e841b"}
Jul 07 15:56:16.603733 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.603721    2573 scope.go:117] "RemoveContainer" containerID="435afb19f2a349cd508e7569e568361b37e145486c7bb2818224ab6a6ef05fff"
Jul 07 15:56:16.604196 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.603665    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"
Jul 07 15:56:16.632935 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.632902    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:16.650861 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.650824    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7817fcef-openshift-default-6f8bf57c67-8wghq"]
Jul 07 15:56:16.881528 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.881449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:16.982999 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:16.982968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:18.597290 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:18.597253    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" path="/var/lib/kubelet/pods/6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b/volumes"
Jul 07 15:56:18.766058 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:18.766026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:26.979464 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:26.979424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:27.077882 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:27.077847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:27.295129 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:27.295017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:27.427691 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:27.427655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:27.543226 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:27.543190    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:28.351896 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:28.351863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:54.429342 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:54.429296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:56:56.063192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:56:56.063161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:02.122093 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:02.122031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:02.284180 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:02.284139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:02.441167 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:02.441042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:18.504927 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:18.504882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:26.678757 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:26.678714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:26.876923 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:26.876886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:26.999906 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:26.999872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:37.728989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:37.728943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:38.427742 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:38.427707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:45.146536 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:45.146499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:45.283785 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:45.283740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:45.427593 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:45.427499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:45.528208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:45.528171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:46.366606 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:46.366573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:46.477970 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:46.477937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:46.577706 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:46.577676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:46.746631 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:46.746587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:48.458208 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:48.458173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:55.185348 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:55.185308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:55.301456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:55.301414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:57:55.812231 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:57:55.812195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:02.551548 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:02.551512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:02.672424 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:02.672378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:02.833746 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:02.833660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:03.191141 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191050    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:03.191436 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191424    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbfe2a1-b582-478b-9be0-caa7305fb518" containerName="maas-api"
Jul 07 15:58:03.191478 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191438    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbfe2a1-b582-478b-9be0-caa7305fb518" containerName="maas-api"
Jul 07 15:58:03.191478 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191453    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" containerName="istio-proxy"
Jul 07 15:58:03.191478 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191459    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" containerName="istio-proxy"
Jul 07 15:58:03.191576 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbfe2a1-b582-478b-9be0-caa7305fb518" containerName="maas-api"
Jul 07 15:58:03.191576 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.191531    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dbee5be-4e59-4f68-b495-8ac7fcc2ec9b" containerName="istio-proxy"
Jul 07 15:58:03.194714 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.194699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.197608 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.197591    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0bcc789a-openshift-default-dockercfg-wzcmp\""
Jul 07 15:58:03.217145 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.217118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:03.279273 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.279240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:03.281650 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281812 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281812 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281812 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqbsl\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.281954 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.281922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.347011 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.346976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:03.382370 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqbsl\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.382986 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.382925    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.383047 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.383011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.383192 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.383169    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.383337 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.383315    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.383374 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.383343    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.385426 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.385396    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.385618 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.385602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.394473 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.394445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.394808 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.394784    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqbsl\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl\") pod \"e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") " pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.505251 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.505214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:03.652968 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.652942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:03.655248 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:58:03.655219    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7810ba1_6335_4c08_9dda_f01b3a510a1e.slice/crio-8e021b8691e7eb3048da2887f75cb16f83715b842fdfd15f9de9cb57d6b2f95e WatchSource:0}: Error finding container 8e021b8691e7eb3048da2887f75cb16f83715b842fdfd15f9de9cb57d6b2f95e: Status 404 returned error can't find the container with id 8e021b8691e7eb3048da2887f75cb16f83715b842fdfd15f9de9cb57d6b2f95e
Jul 07 15:58:03.657337 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.657304    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:03.657429 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.657373    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:03.657429 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:03.657401    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:04.083729 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:04.083688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerStarted","Data":"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"}
Jul 07 15:58:04.083914 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:04.083743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerStarted","Data":"8e021b8691e7eb3048da2887f75cb16f83715b842fdfd15f9de9cb57d6b2f95e"}
Jul 07 15:58:04.114446 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:04.114368    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podStartSLOduration=1.114351893 podStartE2EDuration="1.114351893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:58:04.112724114 +0000 UTC m=+1680.136921384" watchObservedRunningTime="2026-07-07 15:58:04.114351893 +0000 UTC m=+1680.138549162"
Jul 07 15:58:04.505962 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:04.505929    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:04.511003 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:04.510980    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:05.088127 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:05.088096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:05.095246 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:05.095207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:06.058202 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.058163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:06.119456 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.119415    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:06.123235 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.123213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.126021 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.126004    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-0bcc789a-serving-cert\""
Jul 07 15:58:06.126503 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.126491    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:58:06.135409 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.135386    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:06.159329 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.159287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:06.207870 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.207841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.208105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.207957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.208105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.207986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b48b\" (UniqueName: \"kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.259014 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.258976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:06.309515 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.309425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.309515 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.309487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.309515 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.309514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b48b\" (UniqueName: \"kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.309802 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:58:06.309569    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-0bcc789a-serving-cert: secret "maas-api-e2e-mt-0bcc789a-serving-cert" not found
Jul 07 15:58:06.309802 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:58:06.309625    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls podName:6b9f3d09-ae4b-4124-93a8-520cf95fba89 nodeName:}" failed. No retries permitted until 2026-07-07 15:58:06.809609252 +0000 UTC m=+1682.833806500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls") pod "maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" (UID: "6b9f3d09-ae4b-4124-93a8-520cf95fba89") : secret "maas-api-e2e-mt-0bcc789a-serving-cert" not found
Jul 07 15:58:06.310134 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.310113    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.326518 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.326490    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b48b\" (UniqueName: \"kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.446756 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.446716    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:06.812916 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.812883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:06.813137 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.813119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.815762 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.815739    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") pod \"maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") " pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:06.909361 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:06.909332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:07.035392 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:07.035355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:07.177582 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:07.177559    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:07.179245 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:58:07.179220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9f3d09_ae4b_4124_93a8_520cf95fba89.slice/crio-6e0930e71a32884a561b870ff4015d63c8a3eac9e314c1e4e87c7daf62da6015 WatchSource:0}: Error finding container 6e0930e71a32884a561b870ff4015d63c8a3eac9e314c1e4e87c7daf62da6015: Status 404 returned error can't find the container with id 6e0930e71a32884a561b870ff4015d63c8a3eac9e314c1e4e87c7daf62da6015
Jul 07 15:58:08.105213 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:08.105124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" event={"ID":"6b9f3d09-ae4b-4124-93a8-520cf95fba89","Type":"ContainerStarted","Data":"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"}
Jul 07 15:58:08.105213 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:08.105178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" event={"ID":"6b9f3d09-ae4b-4124-93a8-520cf95fba89","Type":"ContainerStarted","Data":"6e0930e71a32884a561b870ff4015d63c8a3eac9e314c1e4e87c7daf62da6015"}
Jul 07 15:58:08.105213 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:08.105198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:08.131022 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:08.130978    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" podStartSLOduration=1.505809432 podStartE2EDuration="2.130962985s" totalImagesPullingTime="625.153553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:58:08.130015451 +0000 UTC m=+1684.154212721" watchObservedRunningTime="2026-07-07 15:58:08.130962985 +0000 UTC m=+1684.155160254"
Jul 07 15:58:10.589528 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:10.589492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:11.297635 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:11.297592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:11.480980 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:11.480940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:11.734486 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:11.734453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:14.116104 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:14.116055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:18.392945 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:18.392901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:18.465906 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:18.465867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:18.829378 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:18.829346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:19.160108 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.159994    2573 generic.go:356] "Generic (PLEG): container finished" podID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerID="099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609" exitCode=0
Jul 07 15:58:19.160108 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.160088    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerDied","Data":"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"}
Jul 07 15:58:19.160582 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.160555    2573 scope.go:117] "RemoveContainer" containerID="099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"
Jul 07 15:58:19.161810 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.161780    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:19.161870 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.161855    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:19.161905 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.161891    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:19.164846 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.164825    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:19.165018 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.164999    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" podUID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" containerName="maas-api" containerID="cri-o://cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6" gracePeriod=30
Jul 07 15:58:19.194119 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.194086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:19.294101 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.294050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:19.440716 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.440690    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:19.538475 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.538440    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") pod \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") "
Jul 07 15:58:19.538653 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.538516    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b48b\" (UniqueName: \"kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b\") pod \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") "
Jul 07 15:58:19.538653 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.538584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca\") pod \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\" (UID: \"6b9f3d09-ae4b-4124-93a8-520cf95fba89\") "
Jul 07 15:58:19.539013 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.538978    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b9f3d09-ae4b-4124-93a8-520cf95fba89" (UID: "6b9f3d09-ae4b-4124-93a8-520cf95fba89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:58:19.540663 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.540634    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b9f3d09-ae4b-4124-93a8-520cf95fba89" (UID: "6b9f3d09-ae4b-4124-93a8-520cf95fba89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:58:19.541061 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.541040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b" (OuterVolumeSpecName: "kube-api-access-4b48b") pod "6b9f3d09-ae4b-4124-93a8-520cf95fba89" (UID: "6b9f3d09-ae4b-4124-93a8-520cf95fba89"). InnerVolumeSpecName "kube-api-access-4b48b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:58:19.639755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.639715    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f3d09-ae4b-4124-93a8-520cf95fba89-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:19.639755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.639749    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f3d09-ae4b-4124-93a8-520cf95fba89-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:19.639755 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:19.639761    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b48b\" (UniqueName: \"kubernetes.io/projected/6b9f3d09-ae4b-4124-93a8-520cf95fba89-kube-api-access-4b48b\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:20.089139 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.089011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:20.167533 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.167498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerStarted","Data":"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"}
Jul 07 15:58:20.168797 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.168767    2573 generic.go:356] "Generic (PLEG): container finished" podID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" containerID="cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6" exitCode=0
Jul 07 15:58:20.168998 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.168801    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"
Jul 07 15:58:20.168998 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.168849    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" event={"ID":"6b9f3d09-ae4b-4124-93a8-520cf95fba89","Type":"ContainerDied","Data":"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"}
Jul 07 15:58:20.168998 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.168897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw" event={"ID":"6b9f3d09-ae4b-4124-93a8-520cf95fba89","Type":"ContainerDied","Data":"6e0930e71a32884a561b870ff4015d63c8a3eac9e314c1e4e87c7daf62da6015"}
Jul 07 15:58:20.168998 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.168919    2573 scope.go:117] "RemoveContainer" containerID="cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"
Jul 07 15:58:20.178321 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.178305    2573 scope.go:117] "RemoveContainer" containerID="cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"
Jul 07 15:58:20.178569 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:58:20.178551    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6\": container with ID starting with cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6 not found: ID does not exist" containerID="cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"
Jul 07 15:58:20.178623 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.178576    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6"} err="failed to get container status \"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6\": rpc error: code = NotFound desc = could not find container \"cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6\": container with ID starting with cda39f326e6ae82da3649b1bbc53ae0e912acd566e76802334d3b53f81f571a6 not found: ID does not exist"
Jul 07 15:58:20.218120 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.218086    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:20.224866 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.224839    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-0bcc789a-c785874c5-2ghjw"]
Jul 07 15:58:20.506437 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.506410    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:20.507390 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.507363    2573 patch_prober.go:28] interesting pod/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 15:58:20.507514 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.507410    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 15:58:20.598285 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:20.598248    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" path="/var/lib/kubelet/pods/6b9f3d09-ae4b-4124-93a8-520cf95fba89/volumes"
Jul 07 15:58:21.506165 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:21.506129    2573 patch_prober.go:28] interesting pod/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 15:58:21.506348 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:21.506184    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 15:58:22.505645 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:22.505614    2573 patch_prober.go:28] interesting pod/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 15:58:22.505984 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:22.505668    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 15:58:23.506149 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:23.506113    2573 patch_prober.go:28] interesting pod/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 15:58:23.506531 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:23.506179    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 15:58:24.509989 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:24.509961    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:24.510472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:24.510368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:24.510966 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:24.510951    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:25.367290 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:25.367263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:25.469890 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:25.469855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:25.606294 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:25.606263    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:25.638319 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:25.638221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:25.885241 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:25.885212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:26.011526 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:26.011494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:26.119010 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:26.118973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:26.200292 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:26.200258    2573 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" secret="" err="secret \"e2e-mt-0bcc789a-openshift-default-dockercfg-wzcmp\" not found"
Jul 07 15:58:26.221594 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:26.221558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:27.204636 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:27.204579    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy" containerID="cri-o://0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f" gracePeriod=30
Jul 07 15:58:30.979109 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:30.979047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:31.079623 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:31.079586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:32.459250 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.459228    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:32.463335 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463335 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqbsl\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463352    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463394    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463472 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463435    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463668 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463491    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463668 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463522    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463668 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463561    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo\") pod \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\" (UID: \"c7810ba1-6335-4c08-9dda-f01b3a510a1e\") "
Jul 07 15:58:32.463668 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463570    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:58:32.463884 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463789    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.463884 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463801    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:58:32.464012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.463983    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:58:32.464443 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.464277    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:58:32.464529 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.464508    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:58:32.465775 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.465750    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:58:32.465963 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.465939    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:58:32.466035 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.465947    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:58:32.466102 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.466088    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl" (OuterVolumeSpecName: "kube-api-access-rqbsl") pod "c7810ba1-6335-4c08-9dda-f01b3a510a1e" (UID: "c7810ba1-6335-4c08-9dda-f01b3a510a1e"). InnerVolumeSpecName "kube-api-access-rqbsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:58:32.564841 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564805    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.564841 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564835    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.564841 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564849    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.565117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564860    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.565117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564872    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.565117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564884    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.565117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564894    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqbsl\" (UniqueName: \"kubernetes.io/projected/c7810ba1-6335-4c08-9dda-f01b3a510a1e-kube-api-access-rqbsl\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.565117 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.564906    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7810ba1-6335-4c08-9dda-f01b3a510a1e-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 15:58:32.604441 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.604408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:32.695283 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.695247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:32.786640 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.786603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:32.896512 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:32.896474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:33.025469 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.025430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:33.239569 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.239538    2573 generic.go:356] "Generic (PLEG): container finished" podID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerID="0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f" exitCode=0
Jul 07 15:58:33.239738 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.239593    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"
Jul 07 15:58:33.239738 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.239623    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerDied","Data":"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"}
Jul 07 15:58:33.239738 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.239680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw" event={"ID":"c7810ba1-6335-4c08-9dda-f01b3a510a1e","Type":"ContainerDied","Data":"8e021b8691e7eb3048da2887f75cb16f83715b842fdfd15f9de9cb57d6b2f95e"}
Jul 07 15:58:33.239738 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.239703    2573 scope.go:117] "RemoveContainer" containerID="0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"
Jul 07 15:58:33.248399 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.248385    2573 scope.go:117] "RemoveContainer" containerID="099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"
Jul 07 15:58:33.255800 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.255785    2573 scope.go:117] "RemoveContainer" containerID="0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"
Jul 07 15:58:33.256082 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:58:33.256041    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f\": container with ID starting with 0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f not found: ID does not exist" containerID="0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"
Jul 07 15:58:33.256142 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.256098    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f"} err="failed to get container status \"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f\": rpc error: code = NotFound desc = could not find container \"0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f\": container with ID starting with 0ead8dad4878a884b6da6b9186d564c5521006e7de41bbd3547ef9731c0e9c8f not found: ID does not exist"
Jul 07 15:58:33.256142 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.256125    2573 scope.go:117] "RemoveContainer" containerID="099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"
Jul 07 15:58:33.256363 ip-10-0-132-109 kubenswrapper[2573]: E0707 15:58:33.256346    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609\": container with ID starting with 099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609 not found: ID does not exist" containerID="099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"
Jul 07 15:58:33.256425 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.256370    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609"} err="failed to get container status \"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609\": rpc error: code = NotFound desc = could not find container \"099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609\": container with ID starting with 099f935bbb8f37a684d126df9b9c3faceefcd14c646016d15d373df3765f2609 not found: ID does not exist"
Jul 07 15:58:33.263133 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.263111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:33.272371 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:33.272352    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0bcc789a-openshift-default-6c5f89cdf5-tgvzw"]
Jul 07 15:58:34.603012 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:34.602972    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" path="/var/lib/kubelet/pods/c7810ba1-6335-4c08-9dda-f01b3a510a1e/volumes"
Jul 07 15:58:39.257680 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:39.257642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:39.359724 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:39.359688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:46.190616 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.190579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:46.494598 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494566    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 15:58:46.494953 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494941    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" containerName="maas-api"
Jul 07 15:58:46.495001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494954    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" containerName="maas-api"
Jul 07 15:58:46.495001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494968    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:46.495001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494973    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:46.495001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494983    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:46.495001 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.494988    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:46.495207 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.495043    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:46.495207 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.495052    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9f3d09-ae4b-4124-93a8-520cf95fba89" containerName="maas-api"
Jul 07 15:58:46.497399 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.497379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.500641 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.500619    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cb778c67-openshift-default-dockercfg-pk2ws\""
Jul 07 15:58:46.520013 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.519983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 15:58:46.545284 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.545255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:46.587112 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587112 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24j7\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587364 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.587630 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.587370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.688663 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.688627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.688872 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.688846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.688951 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.688892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689385    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z24j7\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689455    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689565    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689643    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.689908 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.689792    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.691758 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.691738    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.691858 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.691816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.701175 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.701150    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24j7\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.701265 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.701209    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token\") pod \"e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") " pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.808556 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.808490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:46.870501 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.870420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:46.951741 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.951695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 15:58:46.951993 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:58:46.951968    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d4822f_bf07_414d_818a_0332bc8aa27c.slice/crio-28bd70ed7dc130bcbab8c860a9c761e29d30acf3a04364262dec71823d56ba8e WatchSource:0}: Error finding container 28bd70ed7dc130bcbab8c860a9c761e29d30acf3a04364262dec71823d56ba8e: Status 404 returned error can't find the container with id 28bd70ed7dc130bcbab8c860a9c761e29d30acf3a04364262dec71823d56ba8e
Jul 07 15:58:46.954042 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.954002    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:46.954161 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.954098    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:46.954161 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:46.954144    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:58:47.305491 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:47.305440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerStarted","Data":"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"}
Jul 07 15:58:47.305984 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:47.305532    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerStarted","Data":"28bd70ed7dc130bcbab8c860a9c761e29d30acf3a04364262dec71823d56ba8e"}
Jul 07 15:58:47.401928 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:47.401874    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podStartSLOduration=1.401857439 podStartE2EDuration="1.401857439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:58:47.391616691 +0000 UTC m=+1723.415813961" watchObservedRunningTime="2026-07-07 15:58:47.401857439 +0000 UTC m=+1723.426054788"
Jul 07 15:58:47.808596 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:47.808559    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:48.814305 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:48.814274    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:49.315724 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.315701    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:49.316859 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.316836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:58:49.612829 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.612731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:49.709611 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.709576    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 15:58:49.710258 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.710239    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7810ba1-6335-4c08-9dda-f01b3a510a1e" containerName="istio-proxy"
Jul 07 15:58:49.712904 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.712884    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.714666 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.714615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:49.721570 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.721547    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-cb778c67-serving-cert\""
Jul 07 15:58:49.723049 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.723029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 15:58:49.728547 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.728527    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 15:58:49.790747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.790711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:49.819613 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.819575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.820118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.819618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sm4d\" (UniqueName: \"kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.820118 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.819700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.920273 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.920169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:49.920273 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.920239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.920470 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.920361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.920470 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.920382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sm4d\" (UniqueName: \"kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.920995 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.920975    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.922947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.922918    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:49.938365 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:49.938341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sm4d\" (UniqueName: \"kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d\") pod \"maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") " pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:50.024921 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:50.024887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:50.170547 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:50.170521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 15:58:50.175961 ip-10-0-132-109 kubenswrapper[2573]: W0707 15:58:50.174174    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a8c59b_0e94_4744_a187_cfe990c0ed2e.slice/crio-1b5f90f572e088921351cca1f7f43b95a81bbae1e711f3144f63f0b4af914c97 WatchSource:0}: Error finding container 1b5f90f572e088921351cca1f7f43b95a81bbae1e711f3144f63f0b4af914c97: Status 404 returned error can't find the container with id 1b5f90f572e088921351cca1f7f43b95a81bbae1e711f3144f63f0b4af914c97
Jul 07 15:58:50.305029 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:50.304994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:50.321610 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:50.321577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" event={"ID":"c1a8c59b-0e94-4744-a187-cfe990c0ed2e","Type":"ContainerStarted","Data":"1b5f90f572e088921351cca1f7f43b95a81bbae1e711f3144f63f0b4af914c97"}
Jul 07 15:58:50.406210 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:50.406170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:51.327523 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:51.327489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" event={"ID":"c1a8c59b-0e94-4744-a187-cfe990c0ed2e","Type":"ContainerStarted","Data":"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"}
Jul 07 15:58:51.327944 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:51.327691    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:58:51.351747 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:51.351704    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" podStartSLOduration=2.047711862 podStartE2EDuration="2.351690053s" totalImagesPullingTime="303.978191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:58:51.35087957 +0000 UTC m=+1727.375076842" watchObservedRunningTime="2026-07-07 15:58:51.351690053 +0000 UTC m=+1727.375887322"
Jul 07 15:58:54.046106 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:54.046057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 15:58:57.337105 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:58:57.337060    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 15:59:04.317448 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.317412    2573 patch_prober.go:28] interesting pod/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 07 15:59:04.317847 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.317485    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 07 15:59:04.402499 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.402466    2573 generic.go:356] "Generic (PLEG): container finished" podID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerID="a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29" exitCode=0
Jul 07 15:59:04.402660 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.402541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerDied","Data":"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"}
Jul 07 15:59:04.402947 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.402934    2573 scope.go:117] "RemoveContainer" containerID="a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"
Jul 07 15:59:04.404008 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.403981    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:59:04.404111 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.404092    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:59:04.404156 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:04.404143    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 15:59:05.409555 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:05.409522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerStarted","Data":"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"}
Jul 07 15:59:05.809273 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:05.809236    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:59:05.809488 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:05.809463    2573 patch_prober.go:28] interesting pod/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 07 15:59:05.809564 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:05.809524    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 07 15:59:06.809340 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:06.809301    2573 patch_prober.go:28] interesting pod/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 07 15:59:06.809724 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:06.809359    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 07 15:59:07.809883 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:07.809850    2573 patch_prober.go:28] interesting pod/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 07 15:59:07.810297 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:07.809910    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 07 15:59:08.809578 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:08.809540    2573 patch_prober.go:28] interesting pod/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 07 15:59:08.809741 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:08.809598    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 07 15:59:09.812921 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:09.812890    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:59:09.813331 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:09.813154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:59:09.813766 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:09.813750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 15:59:15.719642 ip-10-0-132-109 kubenswrapper[2573]: I0707 15:59:15.719602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:00.140803 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.140721    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724000-fhmwd"]
Jul 07 16:00:00.143289 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.143274    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"]
Jul 07 16:00:00.143409 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.143387    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:00.145529 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.145513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:00.153183 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.153161    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"]
Jul 07 16:00:00.155846 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.155823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724000-fhmwd"]
Jul 07 16:00:00.180383 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.180359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tmtg\" (UniqueName: \"kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg\") pod \"maas-api-key-cleanup-29724000-fhmwd\" (UID: \"603475ac-5924-4c28-b0f7-367c6a5664bc\") " pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:00.180500 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.180426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68jg\" (UniqueName: \"kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg\") pod \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" (UID: \"f92f5aa2-b3ba-47c9-9119-6ffa9094733e\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:00.281354 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.281307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d68jg\" (UniqueName: \"kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg\") pod \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" (UID: \"f92f5aa2-b3ba-47c9-9119-6ffa9094733e\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:00.281531 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.281429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tmtg\" (UniqueName: \"kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg\") pod \"maas-api-key-cleanup-29724000-fhmwd\" (UID: \"603475ac-5924-4c28-b0f7-367c6a5664bc\") " pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:00.290175 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.290146    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tmtg\" (UniqueName: \"kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg\") pod \"maas-api-key-cleanup-29724000-fhmwd\" (UID: \"603475ac-5924-4c28-b0f7-367c6a5664bc\") " pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:00.290281 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.290191    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68jg\" (UniqueName: \"kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg\") pod \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" (UID: \"f92f5aa2-b3ba-47c9-9119-6ffa9094733e\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:00.457131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.457035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:00.463168 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.463150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:00.643666 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.643643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724000-fhmwd"]
Jul 07 16:00:00.646390 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:00:00.646367    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603475ac_5924_4c28_b0f7_367c6a5664bc.slice/crio-3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789 WatchSource:0}: Error finding container 3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789: Status 404 returned error can't find the container with id 3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789
Jul 07 16:00:00.658789 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.658766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"]
Jul 07 16:00:00.663562 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:00:00.663537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92f5aa2_b3ba_47c9_9119_6ffa9094733e.slice/crio-e7922f7d9153a04f286e89cea02aed59eeb62854fcada9b8868a55d32da4bb4f WatchSource:0}: Error finding container e7922f7d9153a04f286e89cea02aed59eeb62854fcada9b8868a55d32da4bb4f: Status 404 returned error can't find the container with id e7922f7d9153a04f286e89cea02aed59eeb62854fcada9b8868a55d32da4bb4f
Jul 07 16:00:00.669596 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:00.669572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd" event={"ID":"603475ac-5924-4c28-b0f7-367c6a5664bc","Type":"ContainerStarted","Data":"3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789"}
Jul 07 16:00:01.675632 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:01.675603    2573 generic.go:356] "Generic (PLEG): container finished" podID="603475ac-5924-4c28-b0f7-367c6a5664bc" containerID="796eb39ad3da3b3c7e0577c5a37bd7358621c0a5065d65e08d066800b035d2c1" exitCode=0
Jul 07 16:00:01.675939 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:01.675683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd" event={"ID":"603475ac-5924-4c28-b0f7-367c6a5664bc","Type":"ContainerDied","Data":"796eb39ad3da3b3c7e0577c5a37bd7358621c0a5065d65e08d066800b035d2c1"}
Jul 07 16:00:01.677169 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:01.677149    2573 generic.go:356] "Generic (PLEG): container finished" podID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" containerID="2133997d1606d830a1d54cfc93b5d77e10756864f3e49949d6f896455256aee7" exitCode=0
Jul 07 16:00:01.677258 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:01.677178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9" event={"ID":"f92f5aa2-b3ba-47c9-9119-6ffa9094733e","Type":"ContainerDied","Data":"2133997d1606d830a1d54cfc93b5d77e10756864f3e49949d6f896455256aee7"}
Jul 07 16:00:01.677258 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:01.677227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9" event={"ID":"f92f5aa2-b3ba-47c9-9119-6ffa9094733e","Type":"ContainerStarted","Data":"e7922f7d9153a04f286e89cea02aed59eeb62854fcada9b8868a55d32da4bb4f"}
Jul 07 16:00:02.412887 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.412851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:02.822015 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.821995    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:02.837914 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.837893    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:02.908930 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.908897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tmtg\" (UniqueName: \"kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg\") pod \"603475ac-5924-4c28-b0f7-367c6a5664bc\" (UID: \"603475ac-5924-4c28-b0f7-367c6a5664bc\") "
Jul 07 16:00:02.909145 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.908944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d68jg\" (UniqueName: \"kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg\") pod \"f92f5aa2-b3ba-47c9-9119-6ffa9094733e\" (UID: \"f92f5aa2-b3ba-47c9-9119-6ffa9094733e\") "
Jul 07 16:00:02.911227 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.911198    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg" (OuterVolumeSpecName: "kube-api-access-8tmtg") pod "603475ac-5924-4c28-b0f7-367c6a5664bc" (UID: "603475ac-5924-4c28-b0f7-367c6a5664bc"). InnerVolumeSpecName "kube-api-access-8tmtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:00:02.911334 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.911323    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg" (OuterVolumeSpecName: "kube-api-access-d68jg") pod "f92f5aa2-b3ba-47c9-9119-6ffa9094733e" (UID: "f92f5aa2-b3ba-47c9-9119-6ffa9094733e"). InnerVolumeSpecName "kube-api-access-d68jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:00:02.957345 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.957261    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 16:00:02.957529 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:02.957504    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" podUID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" containerName="maas-api" containerID="cri-o://17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d" gracePeriod=30
Jul 07 16:00:03.001380 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.001346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:03.010085 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.010031    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tmtg\" (UniqueName: \"kubernetes.io/projected/603475ac-5924-4c28-b0f7-367c6a5664bc-kube-api-access-8tmtg\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:00:03.010085 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.010059    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d68jg\" (UniqueName: \"kubernetes.io/projected/f92f5aa2-b3ba-47c9-9119-6ffa9094733e-kube-api-access-d68jg\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:00:03.015120 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.015096    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"]
Jul 07 16:00:03.029115 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.029088    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"]
Jul 07 16:00:03.186236 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.186211    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 16:00:03.313690 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.313657    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sm4d\" (UniqueName: \"kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d\") pod \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") "
Jul 07 16:00:03.313886 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.313765    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca\") pod \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") "
Jul 07 16:00:03.313886 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.313788    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls\") pod \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\" (UID: \"c1a8c59b-0e94-4744-a187-cfe990c0ed2e\") "
Jul 07 16:00:03.314177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.314153    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1a8c59b-0e94-4744-a187-cfe990c0ed2e" (UID: "c1a8c59b-0e94-4744-a187-cfe990c0ed2e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:00:03.315907 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.315885    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1a8c59b-0e94-4744-a187-cfe990c0ed2e" (UID: "c1a8c59b-0e94-4744-a187-cfe990c0ed2e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:00:03.315964 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.315910    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d" (OuterVolumeSpecName: "kube-api-access-4sm4d") pod "c1a8c59b-0e94-4744-a187-cfe990c0ed2e" (UID: "c1a8c59b-0e94-4744-a187-cfe990c0ed2e"). InnerVolumeSpecName "kube-api-access-4sm4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:00:03.417202 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.415495    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:00:03.417202 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.415543    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:00:03.417202 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.415558    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sm4d\" (UniqueName: \"kubernetes.io/projected/c1a8c59b-0e94-4744-a187-cfe990c0ed2e-kube-api-access-4sm4d\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:00:03.688369 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.688283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:03.688369 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.688333    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7922f7d9153a04f286e89cea02aed59eeb62854fcada9b8868a55d32da4bb4f"
Jul 07 16:00:03.689653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.689626    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" containerID="17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d" exitCode=0
Jul 07 16:00:03.689734 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.689683    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"
Jul 07 16:00:03.689734 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.689685    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" event={"ID":"c1a8c59b-0e94-4744-a187-cfe990c0ed2e","Type":"ContainerDied","Data":"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"}
Jul 07 16:00:03.689734 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.689731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27" event={"ID":"c1a8c59b-0e94-4744-a187-cfe990c0ed2e","Type":"ContainerDied","Data":"1b5f90f572e088921351cca1f7f43b95a81bbae1e711f3144f63f0b4af914c97"}
Jul 07 16:00:03.689882 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.689760    2573 scope.go:117] "RemoveContainer" containerID="17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"
Jul 07 16:00:03.691182 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.691147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd" event={"ID":"603475ac-5924-4c28-b0f7-367c6a5664bc","Type":"ContainerDied","Data":"3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789"}
Jul 07 16:00:03.691261 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.691183    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724000-fhmwd"
Jul 07 16:00:03.691261 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.691191    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d8b6d9cbe7176a672b476a62222779b85b4d604be46ba0f15b9baeea5720789"
Jul 07 16:00:03.698864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.698842    2573 scope.go:117] "RemoveContainer" containerID="17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"
Jul 07 16:00:03.699155 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:00:03.699139    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d\": container with ID starting with 17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d not found: ID does not exist" containerID="17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"
Jul 07 16:00:03.699224 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.699162    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d"} err="failed to get container status \"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d\": rpc error: code = NotFound desc = could not find container \"17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d\": container with ID starting with 17b434d1704758651a9399395c4980337a068ee7f3622cff7ca24f1159bcc74d not found: ID does not exist"
Jul 07 16:00:03.701644 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:00:03.701619    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:03.705659 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:00:03.705629    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:03.726135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.726105    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 16:00:03.729817 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:00:03.729783    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:03.730061 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:03.730044    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-cb778c67-58b77ddcc9-vsh27"]
Jul 07 16:00:04.571061 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:04.571035    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:00:04.574395 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:04.574376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:00:04.597289 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:00:04.597250    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9\" is forbidden: User \"system:node:ip-10-0-132-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-109.ec2.internal' and this object" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" pod="opendatahub/maas-api-key-cleanup-e2e-mt-cb778c67-29724000-c56s9"
Jul 07 16:00:04.598139 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:04.598119    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" path="/var/lib/kubelet/pods/c1a8c59b-0e94-4744-a187-cfe990c0ed2e/volumes"
Jul 07 16:00:04.598508 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:04.598491    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" path="/var/lib/kubelet/pods/f92f5aa2-b3ba-47c9-9119-6ffa9094733e/volumes"
Jul 07 16:00:08.527110 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:08.527059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:13.622492 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:13.622450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:51.066091 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:51.066012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:51.214314 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:51.214285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:57.252114 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.252052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:57.320632 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.320583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:57.558211 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.558116    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 16:00:57.558429 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.558375    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy" containerID="cri-o://ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62" gracePeriod=30
Jul 07 16:00:57.573819 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.573787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:57.831130 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:57.831042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:58.913288 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:58.913258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:59.021001 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:59.020969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:59.114921 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:59.114883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:00:59.885986 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:00:59.885950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:00.011006 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:00.010971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:01.508187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:01.508158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:02.810329 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.810304    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 16:01:02.938153 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938028    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z24j7\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938153 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938172    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938197    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938280    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938388 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938330    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938650 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert\") pod \"24d4822f-bf07-414d-818a-0332bc8aa27c\" (UID: \"24d4822f-bf07-414d-818a-0332bc8aa27c\") "
Jul 07 16:01:02.938650 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938486    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:01:02.938650 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938512    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:01:02.938650 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938585    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:01:02.939019 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938918    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:02.939019 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938939    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:02.939019 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938955    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:02.939019 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.938977    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:01:02.939269 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.939176    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data" (OuterVolumeSpecName: "istio-data") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:01:02.940591 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.940566    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7" (OuterVolumeSpecName: "kube-api-access-z24j7") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "kube-api-access-z24j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:01:02.940728 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.940706    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token" (OuterVolumeSpecName: "istio-token") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:01:02.940925 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.940903    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:01:02.940925 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.940910    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24d4822f-bf07-414d-818a-0332bc8aa27c" (UID: "24d4822f-bf07-414d-818a-0332bc8aa27c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:01:02.969513 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.969478    2573 generic.go:356] "Generic (PLEG): container finished" podID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerID="ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62" exitCode=0
Jul 07 16:01:02.969671 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.969531    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"
Jul 07 16:01:02.969671 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.969545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerDied","Data":"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"}
Jul 07 16:01:02.969671 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.969596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f" event={"ID":"24d4822f-bf07-414d-818a-0332bc8aa27c","Type":"ContainerDied","Data":"28bd70ed7dc130bcbab8c860a9c761e29d30acf3a04364262dec71823d56ba8e"}
Jul 07 16:01:02.969671 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.969625    2573 scope.go:117] "RemoveContainer" containerID="ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"
Jul 07 16:01:02.979022 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.979004    2573 scope.go:117] "RemoveContainer" containerID="a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"
Jul 07 16:01:02.987137 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.987119    2573 scope.go:117] "RemoveContainer" containerID="ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"
Jul 07 16:01:02.987386 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:01:02.987368    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62\": container with ID starting with ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62 not found: ID does not exist" containerID="ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"
Jul 07 16:01:02.987435 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.987395    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62"} err="failed to get container status \"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62\": rpc error: code = NotFound desc = could not find container \"ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62\": container with ID starting with ab3298a269856fcfcac140b5e4f31d7450f0a339bee4551434c97bb711d6ef62 not found: ID does not exist"
Jul 07 16:01:02.987435 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.987412    2573 scope.go:117] "RemoveContainer" containerID="a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"
Jul 07 16:01:02.987628 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:01:02.987611    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29\": container with ID starting with a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29 not found: ID does not exist" containerID="a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"
Jul 07 16:01:02.987665 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.987634    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29"} err="failed to get container status \"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29\": rpc error: code = NotFound desc = could not find container \"a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29\": container with ID starting with a4d1ccdf9c25a85fcf2c8423a7a89a581a08964c1a2584cf7a7e3c458bbb1d29 not found: ID does not exist"
Jul 07 16:01:02.992847 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.992821    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 16:01:02.999083 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:02.999048    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cb778c67-openshift-default-9f586bcf9-vbm7f"]
Jul 07 16:01:03.040152 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040116    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:03.040152 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040147    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:03.040152 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040157    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:03.040389 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040165    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d4822f-bf07-414d-818a-0332bc8aa27c-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:03.040389 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040173    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d4822f-bf07-414d-818a-0332bc8aa27c-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:03.040389 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:03.040181    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z24j7\" (UniqueName: \"kubernetes.io/projected/24d4822f-bf07-414d-818a-0332bc8aa27c-kube-api-access-z24j7\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:01:04.597739 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:04.597707    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" path="/var/lib/kubelet/pods/24d4822f-bf07-414d-818a-0332bc8aa27c/volumes"
Jul 07 16:01:07.726922 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:07.726893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:07.798017 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:07.797972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:08.449996 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:08.449961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:14.898381 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:14.898331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:14.967984 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:14.967943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:15.037350 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:15.037318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:16.298859 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:16.298811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:25.702208 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:25.702117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:26.826979 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:26.826942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:47.214927 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:47.214884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:53.454139 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:53.454097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:53.526356 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:53.526319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:53.914554 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:53.914520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:54.240805 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.240776    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:01:54.241222 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241197    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241222 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241216    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241232    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" containerName="maas-api"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241238    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" containerName="maas-api"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241248    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241253    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241260    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241265    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241273    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603475ac-5924-4c28-b0f7-367c6a5664bc" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="603475ac-5924-4c28-b0f7-367c6a5664bc" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241328    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241334    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92f5aa2-b3ba-47c9-9119-6ffa9094733e" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241340    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="603475ac-5924-4c28-b0f7-367c6a5664bc" containerName="cleanup"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241347    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d4822f-bf07-414d-818a-0332bc8aa27c" containerName="istio-proxy"
Jul 07 16:01:54.241373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.241353    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a8c59b-0e94-4744-a187-cfe990c0ed2e" containerName="maas-api"
Jul 07 16:01:54.243697 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.243682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.247809 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.247787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-cea508-openshift-default-dockercfg-sv6tp\""
Jul 07 16:01:54.259136 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.259102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:01:54.262780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.262729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:54.397405 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397405 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29jkp\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.397824 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.397654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.410584 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.410555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:54.498337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.498337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.498337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.498337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.498337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29jkp\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498870    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.498955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.499314 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.499130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.500941 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.500920    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.501187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.501168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.508879 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.508855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29jkp\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.509340 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.509319    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token\") pod \"e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") " pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.554399 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.554379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:54.698539 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.698509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:01:54.700292 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:01:54.700263    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43a4416_bede_45ef_941a_ff854d9e3791.slice/crio-7ecf54502b4d99662d3aa64fd88f0fb49ea71f3fe38cd7d8e4ed42deadac06d3 WatchSource:0}: Error finding container 7ecf54502b4d99662d3aa64fd88f0fb49ea71f3fe38cd7d8e4ed42deadac06d3: Status 404 returned error can't find the container with id 7ecf54502b4d99662d3aa64fd88f0fb49ea71f3fe38cd7d8e4ed42deadac06d3
Jul 07 16:01:54.702258 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.702225    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:01:54.702341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.702286    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:01:54.702341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:54.702316    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:01:55.210955 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:55.210865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerStarted","Data":"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"}
Jul 07 16:01:55.210955 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:55.210929    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerStarted","Data":"7ecf54502b4d99662d3aa64fd88f0fb49ea71f3fe38cd7d8e4ed42deadac06d3"}
Jul 07 16:01:55.242837 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:55.242793    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podStartSLOduration=1.242780289 podStartE2EDuration="1.242780289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:01:55.240601979 +0000 UTC m=+1911.264799250" watchObservedRunningTime="2026-07-07 16:01:55.242780289 +0000 UTC m=+1911.266977559"
Jul 07 16:01:55.555274 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:55.555239    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:55.560214 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:55.560190    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:56.215424 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:56.215390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:56.216225 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:56.216205    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:01:57.465815 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.465779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:01:57.583649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.583612    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:01:57.586419 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.586405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.588924 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.588903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-cea508-serving-cert\""
Jul 07 16:01:57.589122 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.589106    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 16:01:57.600607 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.600585    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:01:57.725864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.725779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.725864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.725814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.725864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.725836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvl29\" (UniqueName: \"kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.826660 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.826625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.826660 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.826663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.826869 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.826683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvl29\" (UniqueName: \"kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.826869 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:01:57.826782    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-cea508-serving-cert: secret "maas-api-e2e-inf-a-cea508-serving-cert" not found
Jul 07 16:01:57.826869 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:01:57.826845    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls podName:578f45bf-33c9-4466-94c7-5b5db50ab017 nodeName:}" failed. No retries permitted until 2026-07-07 16:01:58.326829765 +0000 UTC m=+1914.351027015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls") pod "maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" (UID: "578f45bf-33c9-4466-94c7-5b5db50ab017") : secret "maas-api-e2e-inf-a-cea508-serving-cert" not found
Jul 07 16:01:57.827369 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.827350    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:57.838980 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:57.838957    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvl29\" (UniqueName: \"kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:58.330516 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:58.330478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:58.333187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:58.333162    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") pod \"maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") " pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:58.497510 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:58.497468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:58.643054 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:58.642872    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:01:58.645261 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:01:58.645219    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f45bf_33c9_4466_94c7_5b5db50ab017.slice/crio-c54c8f1c0ef7f1dbfeb237669ea6020e7563bba9a8c45b9b2ef66fc4e34bcbeb WatchSource:0}: Error finding container c54c8f1c0ef7f1dbfeb237669ea6020e7563bba9a8c45b9b2ef66fc4e34bcbeb: Status 404 returned error can't find the container with id c54c8f1c0ef7f1dbfeb237669ea6020e7563bba9a8c45b9b2ef66fc4e34bcbeb
Jul 07 16:01:58.646695 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:58.646674    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:01:59.231498 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:59.231468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" event={"ID":"578f45bf-33c9-4466-94c7-5b5db50ab017","Type":"ContainerStarted","Data":"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"}
Jul 07 16:01:59.231611 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:59.231521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" event={"ID":"578f45bf-33c9-4466-94c7-5b5db50ab017","Type":"ContainerStarted","Data":"c54c8f1c0ef7f1dbfeb237669ea6020e7563bba9a8c45b9b2ef66fc4e34bcbeb"}
Jul 07 16:01:59.231611 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:59.231593    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:01:59.254421 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:59.254373    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" podStartSLOduration=1.7442468660000001 podStartE2EDuration="2.254359503s" totalImagesPullingTime="510.112637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:01:59.254043901 +0000 UTC m=+1915.278241162" watchObservedRunningTime="2026-07-07 16:01:59.254359503 +0000 UTC m=+1915.278556823"
Jul 07 16:01:59.541985 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:01:59.541945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:01.928139 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:01.928104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:02.306051 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.306014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:02.598379 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.598288    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:02:02.601889 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.601866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.604720 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.604700    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-54264f-openshift-default-dockercfg-mpsf4\""
Jul 07 16:02:02.612478 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.612454    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:02:02.629799 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.629768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:02.770345 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770513 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770513 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770513 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsbth\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.770794 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.770676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871353 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871353 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsbth\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871353 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871353 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871939 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871939 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871868    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.871939 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871891    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.872103 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.871978    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.872255 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.872237    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.873761 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.873742    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.874118 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.874098    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.881124 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.881103    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.881352 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.881321    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsbth\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth\") pod \"e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") " pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.913312 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.913285    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:02.944916 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:02.944888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:03.070515 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.070484    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:02:03.073551 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:02:03.073522    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7554d43_46d8_4fde_a8bf_da0e58a1b8a5.slice/crio-d7e9ecf68de5c3db502b29d1218fcd414278c1b42ad9a857485b4c2c5f896888 WatchSource:0}: Error finding container d7e9ecf68de5c3db502b29d1218fcd414278c1b42ad9a857485b4c2c5f896888: Status 404 returned error can't find the container with id d7e9ecf68de5c3db502b29d1218fcd414278c1b42ad9a857485b4c2c5f896888
Jul 07 16:02:03.075818 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.075773    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:03.075920 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.075870    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:03.075975 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.075957    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:03.253143 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.253105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerStarted","Data":"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"}
Jul 07 16:02:03.253338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.253168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerStarted","Data":"d7e9ecf68de5c3db502b29d1218fcd414278c1b42ad9a857485b4c2c5f896888"}
Jul 07 16:02:03.279485 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.279435    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podStartSLOduration=1.279415589 podStartE2EDuration="1.279415589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:02:03.27733037 +0000 UTC m=+1919.301527641" watchObservedRunningTime="2026-07-07 16:02:03.279415589 +0000 UTC m=+1919.303612858"
Jul 07 16:02:03.913659 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:03.913624    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:04.919366 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:04.919330    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:05.243471 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.243441    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:02:05.263476 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.263439    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:05.264541 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.264519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:05.284084 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.284031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:05.355856 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.355824    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:02:05.359780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.359747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.362788 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.362764    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-54264f-serving-cert\""
Jul 07 16:02:05.370819 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.370790    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:02:05.376724 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.376695    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:05.499155 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.498829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tkw\" (UniqueName: \"kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.499155 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.498890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.499155 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.498919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.502139 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.500577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:05.599823 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.599785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tkw\" (UniqueName: \"kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.599823 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.599826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.600054 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.599843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.600610 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.600578    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.602378 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.602356    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.609959 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.609938    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tkw\" (UniqueName: \"kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw\") pod \"maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") " pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.672942 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.672889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:05.839179 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.839149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:02:05.841408 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:02:05.841367    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31721c13_2613_4725_babf_604c36f4b7e8.slice/crio-f303d81969041a2bc7bf76794f2b0b244a0be18be42b29a7eff3608673c75f42 WatchSource:0}: Error finding container f303d81969041a2bc7bf76794f2b0b244a0be18be42b29a7eff3608673c75f42: Status 404 returned error can't find the container with id f303d81969041a2bc7bf76794f2b0b244a0be18be42b29a7eff3608673c75f42
Jul 07 16:02:05.945033 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:05.944990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:06.046123 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:06.046014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:06.273347 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:06.273304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" event={"ID":"31721c13-2613-4725-babf-604c36f4b7e8","Type":"ContainerStarted","Data":"f303d81969041a2bc7bf76794f2b0b244a0be18be42b29a7eff3608673c75f42"}
Jul 07 16:02:07.279984 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:07.279947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" event={"ID":"31721c13-2613-4725-babf-604c36f4b7e8","Type":"ContainerStarted","Data":"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"}
Jul 07 16:02:07.280437 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:07.280134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:07.300667 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:07.300612    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" podStartSLOduration=1.674925384 podStartE2EDuration="2.300596708s" totalImagesPullingTime="625.671324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:02:07.299525774 +0000 UTC m=+1923.323723044" watchObservedRunningTime="2026-07-07 16:02:07.300596708 +0000 UTC m=+1923.324794029"
Jul 07 16:02:09.780581 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:09.780542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:10.518425 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:10.518381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:10.625795 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:10.625755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:12.257245 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:12.257199    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 16:02:12.257738 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:12.257272    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 16:02:13.291136 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.291106    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:02:13.312008 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.311977    2573 generic.go:356] "Generic (PLEG): container finished" podID="e43a4416-bede-45ef-941a-ff854d9e3791" containerID="9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea" exitCode=0
Jul 07 16:02:13.312166 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.312014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerDied","Data":"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"}
Jul 07 16:02:13.312399 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.312385    2573 scope.go:117] "RemoveContainer" containerID="9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"
Jul 07 16:02:13.313503 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.313474    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:13.313563 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.313538    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:13.313599 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:13.313570    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:14.318938 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:14.318907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerStarted","Data":"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"}
Jul 07 16:02:14.555319 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:14.555281    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:02:14.555624 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:14.555504    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 16:02:14.556673 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:14.556644    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 16:02:15.554986 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:15.554941    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 16:02:15.555491 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:15.555010    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 16:02:16.555091 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:16.555030    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 16:02:16.555650 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:16.555130    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 16:02:17.555346 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:17.554844    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 16:02:17.555346 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:17.554907    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 16:02:18.559240 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:18.559192    2573 patch_prober.go:28] interesting pod/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 16:02:18.559764 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:18.559308    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 16:02:19.345144 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.345110    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerID="08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1" exitCode=0
Jul 07 16:02:19.345375 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.345189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerDied","Data":"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"}
Jul 07 16:02:19.345615 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.345599    2573 scope.go:117] "RemoveContainer" containerID="08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"
Jul 07 16:02:19.346643 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.346614    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:19.346723 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.346699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:19.346761 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.346748    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:02:19.559628 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.559597    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:02:19.560134 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.560107    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:02:19.560952 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:19.560923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:02:20.015131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.015093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:20.155006 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.154970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:20.264044 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.264012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:20.355354 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.355260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerStarted","Data":"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"}
Jul 07 16:02:20.913893 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.913857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:20.915131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.915097    2573 patch_prober.go:28] interesting pod/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 16:02:20.915245 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:20.915164    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 16:02:21.914297 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:21.914262    2573 patch_prober.go:28] interesting pod/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 16:02:21.914706 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:21.914315    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 16:02:22.913756 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:22.913721    2573 patch_prober.go:28] interesting pod/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 16:02:22.913931 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:22.913779    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 16:02:23.914086 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:23.914019    2573 patch_prober.go:28] interesting pod/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 16:02:23.914574 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:23.914115    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 16:02:24.918195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:24.918159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:24.918679 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:24.918539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:24.919238 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:24.919218    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:02:26.657216 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:26.657188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:26.758051 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:26.758016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:02:31.074148 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:02:31.074107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:04.285860 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:04.285769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:24.005776 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:24.005725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:24.948415 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:24.948380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:25.152538 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.152490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:25.606281 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.606243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:25.705967 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.705935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:25.805410 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.805379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:25.925872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.925794    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:03:25.926058 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.926035    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" podUID="578f45bf-33c9-4466-94c7-5b5db50ab017" containerName="maas-api" containerID="cri-o://068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4" gracePeriod=30
Jul 07 16:03:25.970426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:25.970391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:26.179005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.178940    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:03:26.266027 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.265996    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvl29\" (UniqueName: \"kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29\") pod \"578f45bf-33c9-4466-94c7-5b5db50ab017\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") "
Jul 07 16:03:26.266238 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.266056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") pod \"578f45bf-33c9-4466-94c7-5b5db50ab017\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") "
Jul 07 16:03:26.266238 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.266132    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca\") pod \"578f45bf-33c9-4466-94c7-5b5db50ab017\" (UID: \"578f45bf-33c9-4466-94c7-5b5db50ab017\") "
Jul 07 16:03:26.266550 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.266525    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "578f45bf-33c9-4466-94c7-5b5db50ab017" (UID: "578f45bf-33c9-4466-94c7-5b5db50ab017"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:03:26.268335 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.268299    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "578f45bf-33c9-4466-94c7-5b5db50ab017" (UID: "578f45bf-33c9-4466-94c7-5b5db50ab017"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:03:26.268425 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.268353    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29" (OuterVolumeSpecName: "kube-api-access-qvl29") pod "578f45bf-33c9-4466-94c7-5b5db50ab017" (UID: "578f45bf-33c9-4466-94c7-5b5db50ab017"). InnerVolumeSpecName "kube-api-access-qvl29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:03:26.367784 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.367749    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvl29\" (UniqueName: \"kubernetes.io/projected/578f45bf-33c9-4466-94c7-5b5db50ab017-kube-api-access-qvl29\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:03:26.367784 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.367779    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/578f45bf-33c9-4466-94c7-5b5db50ab017-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:03:26.367784 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.367789    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/578f45bf-33c9-4466-94c7-5b5db50ab017-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:03:26.696191 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.696154    2573 generic.go:356] "Generic (PLEG): container finished" podID="578f45bf-33c9-4466-94c7-5b5db50ab017" containerID="068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4" exitCode=0
Jul 07 16:03:26.696191 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.696195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" event={"ID":"578f45bf-33c9-4466-94c7-5b5db50ab017","Type":"ContainerDied","Data":"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"}
Jul 07 16:03:26.696447 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.696200    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"
Jul 07 16:03:26.696447 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.696247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs" event={"ID":"578f45bf-33c9-4466-94c7-5b5db50ab017","Type":"ContainerDied","Data":"c54c8f1c0ef7f1dbfeb237669ea6020e7563bba9a8c45b9b2ef66fc4e34bcbeb"}
Jul 07 16:03:26.696447 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.696271    2573 scope.go:117] "RemoveContainer" containerID="068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"
Jul 07 16:03:26.705832 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.705808    2573 scope.go:117] "RemoveContainer" containerID="068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"
Jul 07 16:03:26.706116 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:03:26.706097    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4\": container with ID starting with 068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4 not found: ID does not exist" containerID="068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"
Jul 07 16:03:26.706177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.706124    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4"} err="failed to get container status \"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4\": rpc error: code = NotFound desc = could not find container \"068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4\": container with ID starting with 068bc66a6e6ddb15aa35c6d5ed60bea89687f171baf45149e2d1c89406907ca4 not found: ID does not exist"
Jul 07 16:03:26.714694 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.714674    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:03:26.721479 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:26.721459    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-cea508-7d798fd98-r7qxs"]
Jul 07 16:03:28.599680 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:28.599640    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="578f45bf-33c9-4466-94c7-5b5db50ab017" path="/var/lib/kubelet/pods/578f45bf-33c9-4466-94c7-5b5db50ab017/volumes"
Jul 07 16:03:30.685684 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:30.685655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:31.873422 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:31.873383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:03:31.977576 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:03:31.977537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:07.815591 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:07.815556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:08.072269 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.072185    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:04:08.072433 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.072408    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy" containerID="cri-o://527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7" gracePeriod=30
Jul 07 16:04:08.101493 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.101446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:08.341900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.341817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:08.483356 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.483306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:08.943611 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:08.943578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:09.045323 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.045290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:09.148907 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.148864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:09.272845 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.272811    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:04:09.273082 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.273037    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" podUID="31721c13-2613-4725-babf-604c36f4b7e8" containerName="maas-api" containerID="cri-o://4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e" gracePeriod=30
Jul 07 16:04:09.307272 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.307244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:09.523928 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.523861    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:04:09.672399 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.672368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca\") pod \"31721c13-2613-4725-babf-604c36f4b7e8\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") "
Jul 07 16:04:09.672562 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.672421    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9tkw\" (UniqueName: \"kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw\") pod \"31721c13-2613-4725-babf-604c36f4b7e8\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") "
Jul 07 16:04:09.672562 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.672465    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls\") pod \"31721c13-2613-4725-babf-604c36f4b7e8\" (UID: \"31721c13-2613-4725-babf-604c36f4b7e8\") "
Jul 07 16:04:09.672756 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.672734    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31721c13-2613-4725-babf-604c36f4b7e8" (UID: "31721c13-2613-4725-babf-604c36f4b7e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:09.674618 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.674592    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31721c13-2613-4725-babf-604c36f4b7e8" (UID: "31721c13-2613-4725-babf-604c36f4b7e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:04:09.674724 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.674691    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw" (OuterVolumeSpecName: "kube-api-access-p9tkw") pod "31721c13-2613-4725-babf-604c36f4b7e8" (UID: "31721c13-2613-4725-babf-604c36f4b7e8"). InnerVolumeSpecName "kube-api-access-p9tkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:09.773371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.773329    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31721c13-2613-4725-babf-604c36f4b7e8-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:09.773371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.773364    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9tkw\" (UniqueName: \"kubernetes.io/projected/31721c13-2613-4725-babf-604c36f4b7e8-kube-api-access-p9tkw\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:09.773371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.773377    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31721c13-2613-4725-babf-604c36f4b7e8-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:09.913587 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.913498    2573 generic.go:356] "Generic (PLEG): container finished" podID="31721c13-2613-4725-babf-604c36f4b7e8" containerID="4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e" exitCode=0
Jul 07 16:04:09.913587 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.913542    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"
Jul 07 16:04:09.913780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.913582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" event={"ID":"31721c13-2613-4725-babf-604c36f4b7e8","Type":"ContainerDied","Data":"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"}
Jul 07 16:04:09.913780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.913638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k" event={"ID":"31721c13-2613-4725-babf-604c36f4b7e8","Type":"ContainerDied","Data":"f303d81969041a2bc7bf76794f2b0b244a0be18be42b29a7eff3608673c75f42"}
Jul 07 16:04:09.913780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.913668    2573 scope.go:117] "RemoveContainer" containerID="4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"
Jul 07 16:04:09.922923 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.922906    2573 scope.go:117] "RemoveContainer" containerID="4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"
Jul 07 16:04:09.923203 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:09.923185    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e\": container with ID starting with 4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e not found: ID does not exist" containerID="4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"
Jul 07 16:04:09.923256 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.923215    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e"} err="failed to get container status \"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e\": rpc error: code = NotFound desc = could not find container \"4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e\": container with ID starting with 4f379b140c6530025c2a44f1b5ee55d9a42f4c08dd05b5b046e6ad524964ca7e not found: ID does not exist"
Jul 07 16:04:09.935115 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.935095    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:04:09.939456 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:09.939438    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-54264f-5ff7bcdb7b-25k5k"]
Jul 07 16:04:10.603099 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:10.603045    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31721c13-2613-4725-babf-604c36f4b7e8" path="/var/lib/kubelet/pods/31721c13-2613-4725-babf-604c36f4b7e8/volumes"
Jul 07 16:04:13.317919 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.317894    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:04:13.507550 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507520    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.507758 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.507758 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507581    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.507758 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507605    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29jkp\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.507900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.507900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507843    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:13.507900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507876    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.508020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.508020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.508020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507975    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:13.508020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.507995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data\") pod \"e43a4416-bede-45ef-941a-ff854d9e3791\" (UID: \"e43a4416-bede-45ef-941a-ff854d9e3791\") "
Jul 07 16:04:13.508264 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.508160    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:13.508361 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.508313    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:13.508361 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.508349    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.508499 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.508384    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43a4416-bede-45ef-941a-ff854d9e3791-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.508499 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.508401    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.509088 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.509038    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data" (OuterVolumeSpecName: "istio-data") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:13.510141 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.510061    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp" (OuterVolumeSpecName: "kube-api-access-29jkp") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "kube-api-access-29jkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:13.510245 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.510154    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:04:13.510245 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.510157    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:13.510245 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.510175    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token" (OuterVolumeSpecName: "istio-token") pod "e43a4416-bede-45ef-941a-ff854d9e3791" (UID: "e43a4416-bede-45ef-941a-ff854d9e3791"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:13.609360 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609323    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.609360 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609353    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29jkp\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-kube-api-access-29jkp\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.609360 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609363    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43a4416-bede-45ef-941a-ff854d9e3791-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.609360 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609372    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43a4416-bede-45ef-941a-ff854d9e3791-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.609637 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609382    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.609637 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.609390    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43a4416-bede-45ef-941a-ff854d9e3791-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:13.936099 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.935979    2573 generic.go:356] "Generic (PLEG): container finished" podID="e43a4416-bede-45ef-941a-ff854d9e3791" containerID="527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7" exitCode=0
Jul 07 16:04:13.936099 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.936039    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"
Jul 07 16:04:13.936099 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.936051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerDied","Data":"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"}
Jul 07 16:04:13.936374 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.936109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw" event={"ID":"e43a4416-bede-45ef-941a-ff854d9e3791","Type":"ContainerDied","Data":"7ecf54502b4d99662d3aa64fd88f0fb49ea71f3fe38cd7d8e4ed42deadac06d3"}
Jul 07 16:04:13.936374 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.936133    2573 scope.go:117] "RemoveContainer" containerID="527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"
Jul 07 16:04:13.945866 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.945847    2573 scope.go:117] "RemoveContainer" containerID="9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"
Jul 07 16:04:13.953999 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.953983    2573 scope.go:117] "RemoveContainer" containerID="527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"
Jul 07 16:04:13.954248 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:13.954230    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7\": container with ID starting with 527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7 not found: ID does not exist" containerID="527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"
Jul 07 16:04:13.954302 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.954257    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7"} err="failed to get container status \"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7\": rpc error: code = NotFound desc = could not find container \"527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7\": container with ID starting with 527b5943b3c27489df0c67b65c0654f72634a0faf13d55aa3d592b280b1333f7 not found: ID does not exist"
Jul 07 16:04:13.954302 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.954275    2573 scope.go:117] "RemoveContainer" containerID="9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"
Jul 07 16:04:13.954539 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:13.954509    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea\": container with ID starting with 9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea not found: ID does not exist" containerID="9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"
Jul 07 16:04:13.954604 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.954543    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea"} err="failed to get container status \"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea\": rpc error: code = NotFound desc = could not find container \"9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea\": container with ID starting with 9b1e88ec4d30b7761165dba37a65d9fffac8cf3888b79e0e47d72d6b7cbe67ea not found: ID does not exist"
Jul 07 16:04:13.984271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.984244    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:04:13.990464 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:13.990441    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-cea508-openshift-default-7bc79b99c7-wmfbw"]
Jul 07 16:04:14.597842 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:14.597812    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" path="/var/lib/kubelet/pods/e43a4416-bede-45ef-941a-ff854d9e3791/volumes"
Jul 07 16:04:15.404899 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.404862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:15.489941 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.489908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:15.677565 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.677479    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:04:15.678010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.677744    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy" containerID="cri-o://e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f" gracePeriod=30
Jul 07 16:04:15.730674 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.730636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:15.939220 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:15.939134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:16.278535 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.278491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:16.575966 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.575887    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:16.576293 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576280    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:16.576341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576296    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:16.576341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576312    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f45bf-33c9-4466-94c7-5b5db50ab017" containerName="maas-api"
Jul 07 16:04:16.576341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576317    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f45bf-33c9-4466-94c7-5b5db50ab017" containerName="maas-api"
Jul 07 16:04:16.576341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576336    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31721c13-2613-4725-babf-604c36f4b7e8" containerName="maas-api"
Jul 07 16:04:16.576341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576342    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31721c13-2613-4725-babf-604c36f4b7e8" containerName="maas-api"
Jul 07 16:04:16.576496 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576398    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="31721c13-2613-4725-babf-604c36f4b7e8" containerName="maas-api"
Jul 07 16:04:16.576496 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576408    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:16.576496 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576414    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:16.576496 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.576422    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f45bf-33c9-4466-94c7-5b5db50ab017" containerName="maas-api"
Jul 07 16:04:16.579565 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.579549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.582864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.582843    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1c584a-openshift-default-dockercfg-dvghw\""
Jul 07 16:04:16.598515 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.598491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:16.621978 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.621944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:16.636253 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636378 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636378 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbqhk\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636378 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636515 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636515 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636515 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.636653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.636581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbqhk\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.737614 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737552    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.738103 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737629    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.738103 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737840    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.738103 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.737952    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.738212 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.738187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.739566 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.739547    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.739784 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.739766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.750929 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.750904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:16.751561 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.751532    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbqhk\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.751637 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.751622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token\") pod \"e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") " pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:16.889657 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:16.889568    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:17.040278 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:17.040233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dec095a_cc98_4f7e_9a90_9adec1795342.slice/crio-813afc1d5e2d83f557d0a169604f1529bba0b1e37b35f7534fe88a2552f6f946 WatchSource:0}: Error finding container 813afc1d5e2d83f557d0a169604f1529bba0b1e37b35f7534fe88a2552f6f946: Status 404 returned error can't find the container with id 813afc1d5e2d83f557d0a169604f1529bba0b1e37b35f7534fe88a2552f6f946
Jul 07 16:04:17.042280 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.042250    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:17.042855 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.042819    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:17.042939 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.042895    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:17.043055 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.042940    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:17.960402 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.960367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerStarted","Data":"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"}
Jul 07 16:04:17.960992 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.960419    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerStarted","Data":"813afc1d5e2d83f557d0a169604f1529bba0b1e37b35f7534fe88a2552f6f946"}
Jul 07 16:04:17.983359 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:17.983306    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podStartSLOduration=1.98328662 podStartE2EDuration="1.98328662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:17.983008744 +0000 UTC m=+2054.007206007" watchObservedRunningTime="2026-07-07 16:04:17.98328662 +0000 UTC m=+2054.007483891"
Jul 07 16:04:18.890154 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:18.890116    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:18.895023 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:18.894999    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:18.965042 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:18.965013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:18.965940 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:18.965920    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:19.917484 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:19.917444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:19.988280 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:19.988247    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:19.988848 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:19.988831    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:19.988930 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:19.988851    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43a4416-bede-45ef-941a-ff854d9e3791" containerName="istio-proxy"
Jul 07 16:04:19.991734 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:19.991715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.000110 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.000091    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 16:04:20.001623 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.001609    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-1c584a-serving-cert\""
Jul 07 16:04:20.013133 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.013109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:20.022043 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.022016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:20.064119 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.064089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjdh\" (UniqueName: \"kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.064296 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.064230    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.064344 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.064306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.148041 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.147995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:20.165456 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.165422    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.165618 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.165494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.165618 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.165536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjdh\" (UniqueName: \"kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.166235 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.166216    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.168087 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.168038    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.188648 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.188625    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjdh\" (UniqueName: \"kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh\") pod \"maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") " pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.253191 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.253149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:20.302395 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.302361    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:20.447364 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.447336    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:20.449020 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:20.448998    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20337807_da9f_40da_ae83_d83a559ebc1b.slice/crio-d38f8573e5d55bfb721b18ec92706041635e0d817736c9e3f0d22688f4389ee0 WatchSource:0}: Error finding container d38f8573e5d55bfb721b18ec92706041635e0d817736c9e3f0d22688f4389ee0: Status 404 returned error can't find the container with id d38f8573e5d55bfb721b18ec92706041635e0d817736c9e3f0d22688f4389ee0
Jul 07 16:04:20.589757 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.589723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:20.685234 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.685186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:20.921043 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.921018    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:04:20.972632 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972755 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972755 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972674    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972755 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972709    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972755 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972733    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972963 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972777    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972963 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972817    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972963 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsbth\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.972963 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972870    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data\") pod \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\" (UID: \"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5\") "
Jul 07 16:04:20.973178 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972951    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:20.973178 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.972979    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:20.973178 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973100    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:20.973338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973286    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:20.973338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973311    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:20.973338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973323    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:20.973485 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973421    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:20.973961 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.973939    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:20.975500 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.975467    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth" (OuterVolumeSpecName: "kube-api-access-tsbth") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "kube-api-access-tsbth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:20.975500 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.975471    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:20.975640 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.975558    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:04:20.976514 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.976490    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" (UID: "a7554d43-46d8-4fde-a8bf-da0e58a1b8a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:20.977542 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.977518    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerID="e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f" exitCode=0
Jul 07 16:04:20.977605 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.977569    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"
Jul 07 16:04:20.977675 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.977646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerDied","Data":"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"}
Jul 07 16:04:20.977737 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.977713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6" event={"ID":"a7554d43-46d8-4fde-a8bf-da0e58a1b8a5","Type":"ContainerDied","Data":"d7e9ecf68de5c3db502b29d1218fcd414278c1b42ad9a857485b4c2c5f896888"}
Jul 07 16:04:20.977793 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.977746    2573 scope.go:117] "RemoveContainer" containerID="e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"
Jul 07 16:04:20.979244 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.979218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" event={"ID":"20337807-da9f-40da-ae83-d83a559ebc1b","Type":"ContainerStarted","Data":"d38f8573e5d55bfb721b18ec92706041635e0d817736c9e3f0d22688f4389ee0"}
Jul 07 16:04:20.987044 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:20.987023    2573 scope.go:117] "RemoveContainer" containerID="08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"
Jul 07 16:04:21.003835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.003814    2573 scope.go:117] "RemoveContainer" containerID="e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"
Jul 07 16:04:21.004157 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:21.004094    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f\": container with ID starting with e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f not found: ID does not exist" containerID="e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"
Jul 07 16:04:21.004157 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.004120    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f"} err="failed to get container status \"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f\": rpc error: code = NotFound desc = could not find container \"e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f\": container with ID starting with e2b63347adfaef93040fd2bc09da61ae95328c5ae820e5ddabcfe3485165c17f not found: ID does not exist"
Jul 07 16:04:21.004157 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.004137    2573 scope.go:117] "RemoveContainer" containerID="08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"
Jul 07 16:04:21.004379 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:21.004365    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1\": container with ID starting with 08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1 not found: ID does not exist" containerID="08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"
Jul 07 16:04:21.004434 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.004385    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1"} err="failed to get container status \"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1\": rpc error: code = NotFound desc = could not find container \"08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1\": container with ID starting with 08cd1a89e3dffc9d43c5de5cd75543f9000990a56b3e3677e8e949eb01e274e1 not found: ID does not exist"
Jul 07 16:04:21.019373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.019351    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:04:21.023938 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.023915    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-54264f-openshift-default-5f6f997bbf-hkrr6"]
Jul 07 16:04:21.074393 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074308    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.074563 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074428    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.074613 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074574    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.074613 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074595    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.074613 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074605    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsbth\" (UniqueName: \"kubernetes.io/projected/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-kube-api-access-tsbth\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.074720 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.074614    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:21.985396 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.985362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" event={"ID":"20337807-da9f-40da-ae83-d83a559ebc1b","Type":"ContainerStarted","Data":"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"}
Jul 07 16:04:21.985605 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:21.985490    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:22.004108 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:22.004034    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" podStartSLOduration=2.506610057 podStartE2EDuration="3.004016775s" totalImagesPullingTime="497.406718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:22.003129064 +0000 UTC m=+2058.027326343" watchObservedRunningTime="2026-07-07 16:04:22.004016775 +0000 UTC m=+2058.028214075"
Jul 07 16:04:22.598490 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:22.598453    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" path="/var/lib/kubelet/pods/a7554d43-46d8-4fde-a8bf-da0e58a1b8a5/volumes"
Jul 07 16:04:24.428350 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:24.428319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:24.945631 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:24.945593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:25.217827 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.217748    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:04:25.218165 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218151    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.218215 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218166    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.218215 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218182    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.218215 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218188    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.218313 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218251    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.218313 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.218261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7554d43-46d8-4fde-a8bf-da0e58a1b8a5" containerName="istio-proxy"
Jul 07 16:04:25.221316 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.221298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.223670 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.223653    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cc2117-openshift-default-dockercfg-58j7s\""
Jul 07 16:04:25.236018 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.235997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:04:25.263140 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.263109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:25.312424 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312560 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8p2z\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312560 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312560 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312560 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312700 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312700 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312700 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.312700 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.312660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.413648 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.413648 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.413919 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.413919 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.413919 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414113 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.413966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8p2z\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414113 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414113 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414270 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414270 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414245    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414446 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414307    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414501 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414472    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414538 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414499    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.414606 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.414587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.416178 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.416161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.416730 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.416713    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.422958 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.422927    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.423132 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.423114    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8p2z\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z\") pod \"e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") " pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.498999 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.498960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:25.531282 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.531252    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:25.684119 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.684092    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:04:25.685886 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:25.685854    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7af089b_21cb_46d2_9628_580d916f2c99.slice/crio-a4db0a9c21bb08ac6383a470c94580425befc6896086446e9ad428ee634f0953 WatchSource:0}: Error finding container a4db0a9c21bb08ac6383a470c94580425befc6896086446e9ad428ee634f0953: Status 404 returned error can't find the container with id a4db0a9c21bb08ac6383a470c94580425befc6896086446e9ad428ee634f0953
Jul 07 16:04:25.688194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.688159    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:25.688295 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.688225    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:25.688295 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:25.688262    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:26.011422 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:26.011381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerStarted","Data":"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"}
Jul 07 16:04:26.011641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:26.011447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerStarted","Data":"a4db0a9c21bb08ac6383a470c94580425befc6896086446e9ad428ee634f0953"}
Jul 07 16:04:26.036095 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:26.036025    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podStartSLOduration=1.036007434 podStartE2EDuration="1.036007434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:26.034954156 +0000 UTC m=+2062.059151426" watchObservedRunningTime="2026-07-07 16:04:26.036007434 +0000 UTC m=+2062.060204703"
Jul 07 16:04:26.531968 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:26.531932    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:26.537617 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:26.537592    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:27.016230 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:27.016187    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:27.017141 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:27.017121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:27.996649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:27.996621    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:28.134864 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.134828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:28.270144 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.269946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:28.412622 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.412583    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:28.415398 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.415382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.418918 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.418901    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-cc2117-serving-cert\""
Jul 07 16:04:28.444394 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.444367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.444504 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.444419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.444504 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.444488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.451823 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.451795    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:28.537447 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.537342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:28.544916 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.544892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.545024 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.544962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.545024 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.545014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.545143 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:28.545055    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-cc2117-serving-cert: secret "maas-api-e2e-api-b-cc2117-serving-cert" not found
Jul 07 16:04:28.545180 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:28.545157    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls podName:9fd0247b-f689-4d43-b36f-935c7c9b4187 nodeName:}" failed. No retries permitted until 2026-07-07 16:04:29.045137773 +0000 UTC m=+2065.069335024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls") pod "maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" (UID: "9fd0247b-f689-4d43-b36f-935c7c9b4187") : secret "maas-api-e2e-api-b-cc2117-serving-cert" not found
Jul 07 16:04:28.545626 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.545609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.590464 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.590430    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:28.824311 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:28.824220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:29.051949 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.051906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:29.065966 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.065935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") pod \"maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") " pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:29.066849 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.066812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:29.161464 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.161370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:29.326599 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.326565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:29.523820 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:29.523796    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:29.526238 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:29.526196    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd0247b_f689_4d43_b36f_935c7c9b4187.slice/crio-eeeddcb449473c2814fcd13f9afdbe8eb451e357490bb715983fe203ac5f912d WatchSource:0}: Error finding container eeeddcb449473c2814fcd13f9afdbe8eb451e357490bb715983fe203ac5f912d: Status 404 returned error can't find the container with id eeeddcb449473c2814fcd13f9afdbe8eb451e357490bb715983fe203ac5f912d
Jul 07 16:04:30.034162 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:30.033914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" event={"ID":"9fd0247b-f689-4d43-b36f-935c7c9b4187","Type":"ContainerStarted","Data":"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"}
Jul 07 16:04:30.034162 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:30.033963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" event={"ID":"9fd0247b-f689-4d43-b36f-935c7c9b4187","Type":"ContainerStarted","Data":"eeeddcb449473c2814fcd13f9afdbe8eb451e357490bb715983fe203ac5f912d"}
Jul 07 16:04:30.034307 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:30.034164    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:30.056581 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:30.056524    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" podStartSLOduration=1.618185013 podStartE2EDuration="2.056502337s" totalImagesPullingTime="438.317324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:30.054025839 +0000 UTC m=+2066.078223110" watchObservedRunningTime="2026-07-07 16:04:30.056502337 +0000 UTC m=+2066.080699608"
Jul 07 16:04:32.477732 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:32.477626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:33.967116 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:33.966680    2573 patch_prober.go:28] interesting pod/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 16:04:33.967116 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:33.966748    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 16:04:34.060342 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.060294    2573 generic.go:356] "Generic (PLEG): container finished" podID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerID="65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501" exitCode=0
Jul 07 16:04:34.060538 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.060481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerDied","Data":"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"}
Jul 07 16:04:34.061019 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.060993    2573 scope.go:117] "RemoveContainer" containerID="65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"
Jul 07 16:04:34.062603 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.062561    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:34.062680 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.062662    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:34.062760 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:34.062709    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:35.071785 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:35.071750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerStarted","Data":"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"}
Jul 07 16:04:35.891965 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:35.891517    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:35.891965 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:35.891653    2573 patch_prober.go:28] interesting pod/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 16:04:35.891965 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:35.891698    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 16:04:36.045875 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:36.045838    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:36.891016 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:36.890965    2573 patch_prober.go:28] interesting pod/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 16:04:36.891542 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:36.891054    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 16:04:37.890263 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:37.890227    2573 patch_prober.go:28] interesting pod/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 16:04:37.890482 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:37.890292    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 16:04:38.890476 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:38.890432    2573 patch_prober.go:28] interesting pod/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 16:04:38.890885 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:38.890515    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 16:04:39.893672 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:39.893639    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:39.894141 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:39.893977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:39.894750 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:39.894737    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:40.725659 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:40.725560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:41.090559 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.090532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:41.110484 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.110456    2573 generic.go:356] "Generic (PLEG): container finished" podID="c7af089b-21cb-46d2-9628-580d916f2c99" containerID="ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886" exitCode=0
Jul 07 16:04:41.110653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.110539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerDied","Data":"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"}
Jul 07 16:04:41.111097 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.111058    2573 scope.go:117] "RemoveContainer" containerID="ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"
Jul 07 16:04:41.112037 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.112012    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:41.112146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.112103    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:41.112146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.112135    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:41.281226 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.281185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:41.387955 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.387846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:41.518218 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.518185    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:41.518459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.518428    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" podUID="20337807-da9f-40da-ae83-d83a559ebc1b" containerName="maas-api" containerID="cri-o://9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5" gracePeriod=30
Jul 07 16:04:41.554423 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.554387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:41.777853 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.777826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:41.892151 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.892030    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca\") pod \"20337807-da9f-40da-ae83-d83a559ebc1b\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") "
Jul 07 16:04:41.892151 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.892143    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls\") pod \"20337807-da9f-40da-ae83-d83a559ebc1b\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") "
Jul 07 16:04:41.892394 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.892216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsjdh\" (UniqueName: \"kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh\") pod \"20337807-da9f-40da-ae83-d83a559ebc1b\" (UID: \"20337807-da9f-40da-ae83-d83a559ebc1b\") "
Jul 07 16:04:41.892394 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.892382    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20337807-da9f-40da-ae83-d83a559ebc1b" (UID: "20337807-da9f-40da-ae83-d83a559ebc1b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:41.892568 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.892545    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20337807-da9f-40da-ae83-d83a559ebc1b-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:41.894405 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.894380    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20337807-da9f-40da-ae83-d83a559ebc1b" (UID: "20337807-da9f-40da-ae83-d83a559ebc1b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:04:41.894405 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.894381    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh" (OuterVolumeSpecName: "kube-api-access-hsjdh") pod "20337807-da9f-40da-ae83-d83a559ebc1b" (UID: "20337807-da9f-40da-ae83-d83a559ebc1b"). InnerVolumeSpecName "kube-api-access-hsjdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:41.993900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.993861    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsjdh\" (UniqueName: \"kubernetes.io/projected/20337807-da9f-40da-ae83-d83a559ebc1b-kube-api-access-hsjdh\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:41.993900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:41.993895    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20337807-da9f-40da-ae83-d83a559ebc1b-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:42.016371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.016345    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:42.125248 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.125216    2573 generic.go:356] "Generic (PLEG): container finished" podID="20337807-da9f-40da-ae83-d83a559ebc1b" containerID="9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5" exitCode=0
Jul 07 16:04:42.125714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.125293    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"
Jul 07 16:04:42.125714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.125312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" event={"ID":"20337807-da9f-40da-ae83-d83a559ebc1b","Type":"ContainerDied","Data":"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"}
Jul 07 16:04:42.125714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.125471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk" event={"ID":"20337807-da9f-40da-ae83-d83a559ebc1b","Type":"ContainerDied","Data":"d38f8573e5d55bfb721b18ec92706041635e0d817736c9e3f0d22688f4389ee0"}
Jul 07 16:04:42.125714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.125530    2573 scope.go:117] "RemoveContainer" containerID="9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"
Jul 07 16:04:42.127683 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.127657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerStarted","Data":"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"}
Jul 07 16:04:42.134655 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.134639    2573 scope.go:117] "RemoveContainer" containerID="9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"
Jul 07 16:04:42.134873 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:42.134857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5\": container with ID starting with 9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5 not found: ID does not exist" containerID="9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"
Jul 07 16:04:42.134920 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.134882    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5"} err="failed to get container status \"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5\": rpc error: code = NotFound desc = could not find container \"9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5\": container with ID starting with 9a665b5b04ef95c6b9e5e85b018d8177c556d32f51e25544b0321072194a47b5 not found: ID does not exist"
Jul 07 16:04:42.181125 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.181016    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:42.185294 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.185267    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1c584a-5d49897cfc-c4psk"]
Jul 07 16:04:42.531656 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.531623    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:42.532816 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.532792    2573 patch_prober.go:28] interesting pod/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 07 16:04:42.532923 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.532841    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 07 16:04:42.598385 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:42.598354    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20337807-da9f-40da-ae83-d83a559ebc1b" path="/var/lib/kubelet/pods/20337807-da9f-40da-ae83-d83a559ebc1b/volumes"
Jul 07 16:04:43.532552 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:43.532517    2573 patch_prober.go:28] interesting pod/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 07 16:04:43.532951 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:43.532573    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 07 16:04:44.531905 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:44.531871    2573 patch_prober.go:28] interesting pod/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 07 16:04:44.532115 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:44.531926    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 07 16:04:45.532363 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:45.532332    2573 patch_prober.go:28] interesting pod/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 07 16:04:45.532778 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:45.532388    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 07 16:04:46.536435 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:46.536406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:46.536869 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:46.536778    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:46.537536 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:46.537518    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:47.184597 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.184563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:47.306746 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.306707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:47.465210 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.465116    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:47.465422 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.465357    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy" containerID="cri-o://f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12" gracePeriod=30
Jul 07 16:04:47.467314 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.467273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:47.691798 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.691759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:47.847995 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:47.847956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:48.334916 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.334879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:48.523913 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.523874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:48.619844 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.619743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:48.805802 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.805768    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:48.806229 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.805998    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" podUID="9fd0247b-f689-4d43-b36f-935c7c9b4187" containerName="maas-api" containerID="cri-o://49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673" gracePeriod=30
Jul 07 16:04:48.832237 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:48.832209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:49.063055 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.063030    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:49.160541 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.160513    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca\") pod \"9fd0247b-f689-4d43-b36f-935c7c9b4187\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") "
Jul 07 16:04:49.160743 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.160574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29\") pod \"9fd0247b-f689-4d43-b36f-935c7c9b4187\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") "
Jul 07 16:04:49.160743 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.160611    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") pod \"9fd0247b-f689-4d43-b36f-935c7c9b4187\" (UID: \"9fd0247b-f689-4d43-b36f-935c7c9b4187\") "
Jul 07 16:04:49.160966 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.160937    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fd0247b-f689-4d43-b36f-935c7c9b4187" (UID: "9fd0247b-f689-4d43-b36f-935c7c9b4187"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:49.162887 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.162861    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29" (OuterVolumeSpecName: "kube-api-access-fhn29") pod "9fd0247b-f689-4d43-b36f-935c7c9b4187" (UID: "9fd0247b-f689-4d43-b36f-935c7c9b4187"). InnerVolumeSpecName "kube-api-access-fhn29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:49.162887 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.162869    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fd0247b-f689-4d43-b36f-935c7c9b4187" (UID: "9fd0247b-f689-4d43-b36f-935c7c9b4187"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:04:49.165093 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.165052    2573 generic.go:356] "Generic (PLEG): container finished" podID="9fd0247b-f689-4d43-b36f-935c7c9b4187" containerID="49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673" exitCode=0
Jul 07 16:04:49.165212 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.165130    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"
Jul 07 16:04:49.165212 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.165167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" event={"ID":"9fd0247b-f689-4d43-b36f-935c7c9b4187","Type":"ContainerDied","Data":"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"}
Jul 07 16:04:49.165316 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.165219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t" event={"ID":"9fd0247b-f689-4d43-b36f-935c7c9b4187","Type":"ContainerDied","Data":"eeeddcb449473c2814fcd13f9afdbe8eb451e357490bb715983fe203ac5f912d"}
Jul 07 16:04:49.165316 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.165243    2573 scope.go:117] "RemoveContainer" containerID="49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"
Jul 07 16:04:49.180601 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.180586    2573 scope.go:117] "RemoveContainer" containerID="49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"
Jul 07 16:04:49.180886 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:49.180870    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673\": container with ID starting with 49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673 not found: ID does not exist" containerID="49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"
Jul 07 16:04:49.180946 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.180894    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673"} err="failed to get container status \"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673\": rpc error: code = NotFound desc = could not find container \"49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673\": container with ID starting with 49396d1da5002ee13e5d385a6d610972d8566e996d8cc3c9e7565f113331c673 not found: ID does not exist"
Jul 07 16:04:49.192015 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.191993    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:49.195461 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.195431    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-cc2117-5b79dd94f5-vx58t"]
Jul 07 16:04:49.261780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.261752    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fd0247b-f689-4d43-b36f-935c7c9b4187-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:49.261780 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.261779    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9fd0247b-f689-4d43-b36f-935c7c9b4187-kube-api-access-fhn29\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:49.261942 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:49.261790    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fd0247b-f689-4d43-b36f-935c7c9b4187-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:50.597978 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:50.597941    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fd0247b-f689-4d43-b36f-935c7c9b4187" path="/var/lib/kubelet/pods/9fd0247b-f689-4d43-b36f-935c7c9b4187/volumes"
Jul 07 16:04:52.718757 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.718732    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:52.892703 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892614    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892703 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892665    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892703 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892694    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892974 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892718    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892974 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892756    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbqhk\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892974 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892879    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.892974 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892942    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.893209 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.892975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.893209 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893026    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs\") pod \"3dec095a-cc98-4f7e-9a90-9adec1795342\" (UID: \"3dec095a-cc98-4f7e-9a90-9adec1795342\") "
Jul 07 16:04:52.893374 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893342    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:52.893830 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893573    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:52.893830 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893564    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:52.894100 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893733    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:52.894100 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.893871    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data" (OuterVolumeSpecName: "istio-data") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:52.895182 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.895143    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token" (OuterVolumeSpecName: "istio-token") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:52.895182 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.895162    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:52.895422 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.895401    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk" (OuterVolumeSpecName: "kube-api-access-fbqhk") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "kube-api-access-fbqhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:52.895472 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.895398    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3dec095a-cc98-4f7e-9a90-9adec1795342" (UID: "3dec095a-cc98-4f7e-9a90-9adec1795342"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:04:52.994432 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994389    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994432 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994426    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994432 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994440    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbqhk\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-kube-api-access-fbqhk\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994453    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dec095a-cc98-4f7e-9a90-9adec1795342-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994464    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994474    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994485    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994495    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:52.994689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:52.994505    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dec095a-cc98-4f7e-9a90-9adec1795342-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:04:53.187872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.187783    2573 generic.go:356] "Generic (PLEG): container finished" podID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerID="f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12" exitCode=0
Jul 07 16:04:53.187872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.187831    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"
Jul 07 16:04:53.187872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.187840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerDied","Data":"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"}
Jul 07 16:04:53.188155 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.187887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4" event={"ID":"3dec095a-cc98-4f7e-9a90-9adec1795342","Type":"ContainerDied","Data":"813afc1d5e2d83f557d0a169604f1529bba0b1e37b35f7534fe88a2552f6f946"}
Jul 07 16:04:53.188155 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.187910    2573 scope.go:117] "RemoveContainer" containerID="f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"
Jul 07 16:04:53.197294 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.197279    2573 scope.go:117] "RemoveContainer" containerID="65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"
Jul 07 16:04:53.204798 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.204780    2573 scope.go:117] "RemoveContainer" containerID="f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"
Jul 07 16:04:53.205055 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:53.205038    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12\": container with ID starting with f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12 not found: ID does not exist" containerID="f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"
Jul 07 16:04:53.205113 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.205082    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12"} err="failed to get container status \"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12\": rpc error: code = NotFound desc = could not find container \"f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12\": container with ID starting with f391970908872d69a400fa934493b2db2c042069f468c28a040d7a31f3f7ba12 not found: ID does not exist"
Jul 07 16:04:53.205113 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.205101    2573 scope.go:117] "RemoveContainer" containerID="65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"
Jul 07 16:04:53.205351 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:04:53.205333    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501\": container with ID starting with 65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501 not found: ID does not exist" containerID="65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"
Jul 07 16:04:53.205389 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.205358    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501"} err="failed to get container status \"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501\": rpc error: code = NotFound desc = could not find container \"65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501\": container with ID starting with 65e10768d94119e87b5cd2371ac9d818dd55b2458354b31abcfa3a2a9c438501 not found: ID does not exist"
Jul 07 16:04:53.223217 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.223197    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:53.225524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:53.225500    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1c584a-openshift-default-78f886f595-8n8p4"]
Jul 07 16:04:54.299141 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.299106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:54.403988 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.403959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:54.540303 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.540268    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:04:54.540534 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.540510    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy" containerID="cri-o://cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684" gracePeriod=30
Jul 07 16:04:54.567269 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.567193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:54.598122 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.598089    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" path="/var/lib/kubelet/pods/3dec095a-cc98-4f7e-9a90-9adec1795342/volumes"
Jul 07 16:04:54.894987 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:54.894897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:55.166128 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.166005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:55.445194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445113    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445478    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445490    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445506    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20337807-da9f-40da-ae83-d83a559ebc1b" containerName="maas-api"
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445511    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20337807-da9f-40da-ae83-d83a559ebc1b" containerName="maas-api"
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445517    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd0247b-f689-4d43-b36f-935c7c9b4187" containerName="maas-api"
Jul 07 16:04:55.445524 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445523    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd0247b-f689-4d43-b36f-935c7c9b4187" containerName="maas-api"
Jul 07 16:04:55.445712 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445585    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:55.445712 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445591    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd0247b-f689-4d43-b36f-935c7c9b4187" containerName="maas-api"
Jul 07 16:04:55.445712 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.445600    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20337807-da9f-40da-ae83-d83a559ebc1b" containerName="maas-api"
Jul 07 16:04:55.448791 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.448774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.451317 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.451297    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4e777d-openshift-default-dockercfg-tv6q4\""
Jul 07 16:04:55.461012 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.460991    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:04:55.474232 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.474204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:55.618759 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgmm\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.618937 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.618937 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.618937 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.618937 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.618937 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.619131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.618950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.619131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.619003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.619131 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.619045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.719912 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.719912 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.719912 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.719912 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.719964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720271 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgmm\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720527 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720269    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720527 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720314    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720695    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720783 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720737    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.720783 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.720751    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.722519 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.722495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.722658 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.722640    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.731363 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.731343    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgmm\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.731533 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.731515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token\") pod \"e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") " pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.752373 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.752341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:55.759177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.759159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:55.899358 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.899331    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:04:55.901307 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:55.901283    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode928fcca_d78c_44db_b197_cbc143ae5c36.slice/crio-652143d9f339149f0987c2a031a97704a5d71291b5b5e93d49052c8b370670f4 WatchSource:0}: Error finding container 652143d9f339149f0987c2a031a97704a5d71291b5b5e93d49052c8b370670f4: Status 404 returned error can't find the container with id 652143d9f339149f0987c2a031a97704a5d71291b5b5e93d49052c8b370670f4
Jul 07 16:04:55.903353 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.903322    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:55.903413 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.903388    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:55.903457 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:55.903418    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:04:56.206847 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:56.206806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerStarted","Data":"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"}
Jul 07 16:04:56.207137 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:56.206889    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerStarted","Data":"652143d9f339149f0987c2a031a97704a5d71291b5b5e93d49052c8b370670f4"}
Jul 07 16:04:56.233003 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:56.232954    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podStartSLOduration=1.232937725 podStartE2EDuration="1.232937725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:56.231236599 +0000 UTC m=+2092.255433873" watchObservedRunningTime="2026-07-07 16:04:56.232937725 +0000 UTC m=+2092.257134995"
Jul 07 16:04:56.760152 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:56.760118    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:56.764931 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:56.764907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:57.212600 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:57.212514    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:57.213458 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:57.213436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:04:58.179336 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.179304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:58.280286 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.280243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:58.281890 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.281863    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:04:58.282352 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.282335    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:58.282449 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.282354    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:58.282449 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.282437    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dec095a-cc98-4f7e-9a90-9adec1795342" containerName="istio-proxy"
Jul 07 16:04:58.284530 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.284512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.289618 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.289596    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\""
Jul 07 16:04:58.289713 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.289676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-4e777d-serving-cert\""
Jul 07 16:04:58.308980 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.308957    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:04:58.377191 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.377148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:58.447967 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.447870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q7l7\" (UniqueName: \"kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.448162 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.448005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.448162 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.448093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.548989 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.548953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.549187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.549016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q7l7\" (UniqueName: \"kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.549187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.549154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.549647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.549628    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.551746 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.551725    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.560314 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.560290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q7l7\" (UniqueName: \"kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7\") pod \"maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") " pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.595196 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.595172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:58.689382 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.689349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:58.736416 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:58.736376    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:04:58.738676 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:04:58.738646    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdded68c_8abf_4bc7_aa1d_603b42197c59.slice/crio-6f5a2d3fbb6af2f19fde3967cba2ba4d9fe51f287c066a19f3f8f6d231d68c78 WatchSource:0}: Error finding container 6f5a2d3fbb6af2f19fde3967cba2ba4d9fe51f287c066a19f3f8f6d231d68c78: Status 404 returned error can't find the container with id 6f5a2d3fbb6af2f19fde3967cba2ba4d9fe51f287c066a19f3f8f6d231d68c78
Jul 07 16:04:59.001791 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.001688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:59.117714 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.117686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:04:59.226547 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.226512    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" event={"ID":"bdded68c-8abf-4bc7-aa1d-603b42197c59","Type":"ContainerStarted","Data":"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"}
Jul 07 16:04:59.226944 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.226567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" event={"ID":"bdded68c-8abf-4bc7-aa1d-603b42197c59","Type":"ContainerStarted","Data":"6f5a2d3fbb6af2f19fde3967cba2ba4d9fe51f287c066a19f3f8f6d231d68c78"}
Jul 07 16:04:59.226944 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.226593    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:04:59.267529 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.267432    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" podStartSLOduration=0.919573298 podStartE2EDuration="1.267415968s" totalImagesPullingTime="347.84267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:04:59.265012154 +0000 UTC m=+2095.289209424" watchObservedRunningTime="2026-07-07 16:04:59.267415968 +0000 UTC m=+2095.291613237"
Jul 07 16:04:59.803232 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.803171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:04:59.965472 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965439    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965631 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965499    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965631 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965631 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965574    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965631 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965611    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965841 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965639    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8p2z\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965841 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965718    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965841 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965756    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.965841 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.965798    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket\") pod \"c7af089b-21cb-46d2-9628-580d916f2c99\" (UID: \"c7af089b-21cb-46d2-9628-580d916f2c99\") "
Jul 07 16:04:59.966328 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.966049    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:04:59.966328 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.966287    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:59.966328 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.966310    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:59.966735 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.966325    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:59.966735 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.966451    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:59.967858 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.967829    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:04:59.968219 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.968192    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:04:59.968422 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.968402    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z" (OuterVolumeSpecName: "kube-api-access-h8p2z") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "kube-api-access-h8p2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:04:59.968488 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:04:59.968443    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7af089b-21cb-46d2-9628-580d916f2c99" (UID: "c7af089b-21cb-46d2-9628-580d916f2c99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067544    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067576    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067590    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067603    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7af089b-21cb-46d2-9628-580d916f2c99-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067615    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067627    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067634 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067637    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7af089b-21cb-46d2-9628-580d916f2c99-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067946 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067648    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7af089b-21cb-46d2-9628-580d916f2c99-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.067946 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.067659    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8p2z\" (UniqueName: \"kubernetes.io/projected/c7af089b-21cb-46d2-9628-580d916f2c99-kube-api-access-h8p2z\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:05:00.232467 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.232428    2573 generic.go:356] "Generic (PLEG): container finished" podID="c7af089b-21cb-46d2-9628-580d916f2c99" containerID="cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684" exitCode=0
Jul 07 16:05:00.232835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.232475    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"
Jul 07 16:05:00.232835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.232513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerDied","Data":"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"}
Jul 07 16:05:00.232835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.232565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88" event={"ID":"c7af089b-21cb-46d2-9628-580d916f2c99","Type":"ContainerDied","Data":"a4db0a9c21bb08ac6383a470c94580425befc6896086446e9ad428ee634f0953"}
Jul 07 16:05:00.232835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.232588    2573 scope.go:117] "RemoveContainer" containerID="cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"
Jul 07 16:05:00.242177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.242157    2573 scope.go:117] "RemoveContainer" containerID="ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"
Jul 07 16:05:00.250087 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.250053    2573 scope.go:117] "RemoveContainer" containerID="cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"
Jul 07 16:05:00.250363 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:05:00.250344    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684\": container with ID starting with cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684 not found: ID does not exist" containerID="cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"
Jul 07 16:05:00.250431 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.250375    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684"} err="failed to get container status \"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684\": rpc error: code = NotFound desc = could not find container \"cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684\": container with ID starting with cc781537e71753033f92f4ef2adb5b61540626689bc7e79560419d19dbeec684 not found: ID does not exist"
Jul 07 16:05:00.250431 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.250399    2573 scope.go:117] "RemoveContainer" containerID="ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"
Jul 07 16:05:00.250665 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:05:00.250646    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886\": container with ID starting with ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886 not found: ID does not exist" containerID="ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"
Jul 07 16:05:00.250711 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.250673    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886"} err="failed to get container status \"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886\": rpc error: code = NotFound desc = could not find container \"ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886\": container with ID starting with ac591ca820f535633f29f7a8c88b2286f9422de9c2a2565ff406faf71a248886 not found: ID does not exist"
Jul 07 16:05:00.260918 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.260898    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:05:00.264286 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.264267    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cc2117-openshift-default-74785dbfd7-f5m88"]
Jul 07 16:05:00.598016 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:00.597981    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" path="/var/lib/kubelet/pods/c7af089b-21cb-46d2-9628-580d916f2c99/volumes"
Jul 07 16:05:02.681580 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:02.681547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:03.051426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.051393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:03.286355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.286315    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:05:03.286942 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.286920    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:03.287032 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.286946    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:03.287095 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.287061    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:03.287095 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.287093    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:03.290429 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.290411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.292900 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.292877    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-82510b-openshift-default-dockercfg-htjwp\""
Jul 07 16:05:03.298964 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.298806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9tn\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.298964 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.298887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.298964 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.298912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.298967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.298995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.299084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.299166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299195 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.299192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.299421 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.299279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.300647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.300602    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:05:03.314538 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.314472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:03.399893 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.399862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.399893 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.399896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400163 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400163 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9tn\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400267 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400351 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400418 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400418 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400506 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400421    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400506 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400506 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400506 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.400836 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.400808    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.401348 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.401312    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.402919 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.402890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.403473 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.403449    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.409757 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.409731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.409968 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.409946    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9tn\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn\") pod \"e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") " pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.435206 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.435169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:03.603693 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.603604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:03.777171 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.771739    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:05:03.782830 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:05:03.782784    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c00129c_f19e_471f_9c03_fbd9f7b2d3ec.slice/crio-57fb4d58ee4f7d29fece73a71a984ab80176dce18fee631c55a5476b6a380872 WatchSource:0}: Error finding container 57fb4d58ee4f7d29fece73a71a984ab80176dce18fee631c55a5476b6a380872: Status 404 returned error can't find the container with id 57fb4d58ee4f7d29fece73a71a984ab80176dce18fee631c55a5476b6a380872
Jul 07 16:05:03.785767 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.785726    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:03.785862 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.785821    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:03.785910 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:03.785866    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:04.272676 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.271632    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerStarted","Data":"1340f09e361d3f902df928a1bb3142fdfb211c0fb80b10e34f549fb8ba84ec40"}
Jul 07 16:05:04.272676 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.271704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerStarted","Data":"57fb4d58ee4f7d29fece73a71a984ab80176dce18fee631c55a5476b6a380872"}
Jul 07 16:05:04.297977 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.297918    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podStartSLOduration=1.297899541 podStartE2EDuration="1.297899541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:04.297870404 +0000 UTC m=+2100.322067689" watchObservedRunningTime="2026-07-07 16:05:04.297899541 +0000 UTC m=+2100.322096812"
Jul 07 16:05:04.603962 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.603788    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:04.610366 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.610340    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:04.611412 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.611392    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:05:04.613536 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:04.613519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:05:05.238406 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:05.238379    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:05:05.279876 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:05.279836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:05.281280 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:05.281256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:06.267194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.267137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:06.357092 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.350986    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:05:06.357092 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.351593    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:06.357092 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.351612    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7af089b-21cb-46d2-9628-580d916f2c99" containerName="istio-proxy"
Jul 07 16:05:06.363544 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.361206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.372199 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.369742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:05:06.372199 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.369902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-82510b-serving-cert\""
Jul 07 16:05:06.411371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.411334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:06.427449 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.427417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24vds\" (UniqueName: \"kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.427598 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.427464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.427598 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.427523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.528187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.528105    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.528187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.528152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.528372 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.528215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24vds\" (UniqueName: \"kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.528372 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:05:06.528318    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-82510b-serving-cert: secret "maas-api-e2e-shared-b-82510b-serving-cert" not found
Jul 07 16:05:06.528455 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:05:06.528401    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls podName:51ba122a-5ab6-4ab5-88fb-0f2406525a2d nodeName:}" failed. No retries permitted until 2026-07-07 16:05:07.028379955 +0000 UTC m=+2103.052577204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls") pod "maas-api-e2e-shared-b-82510b-54577df9df-487kj" (UID: "51ba122a-5ab6-4ab5-88fb-0f2406525a2d") : secret "maas-api-e2e-shared-b-82510b-serving-cert" not found
Jul 07 16:05:06.528880 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.528860    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.538107 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.538085    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24vds\" (UniqueName: \"kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:06.792186 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:06.792095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:07.033233 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.033203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:07.035801 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.035777    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-82510b-54577df9df-487kj\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") " pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:07.144724 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.144639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:07.250570 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.250414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:07.300189 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.300159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:07.456783 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:07.456623    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:05:07.459806 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:05:07.459757    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ba122a_5ab6_4ab5_88fb_0f2406525a2d.slice/crio-b383f9d09cf916f12f82b1c7b17e99c4164fa865bb44cab23c1485fa06e12f59 WatchSource:0}: Error finding container b383f9d09cf916f12f82b1c7b17e99c4164fa865bb44cab23c1485fa06e12f59: Status 404 returned error can't find the container with id b383f9d09cf916f12f82b1c7b17e99c4164fa865bb44cab23c1485fa06e12f59
Jul 07 16:05:08.300423 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:08.300386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" event={"ID":"51ba122a-5ab6-4ab5-88fb-0f2406525a2d","Type":"ContainerStarted","Data":"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"}
Jul 07 16:05:08.300932 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:08.300443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" event={"ID":"51ba122a-5ab6-4ab5-88fb-0f2406525a2d","Type":"ContainerStarted","Data":"b383f9d09cf916f12f82b1c7b17e99c4164fa865bb44cab23c1485fa06e12f59"}
Jul 07 16:05:08.300932 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:08.300637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:08.321884 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:08.321834    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" podStartSLOduration=1.977251047 podStartE2EDuration="2.32181743s" totalImagesPullingTime="344.566383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:08.320333285 +0000 UTC m=+2104.344530560" watchObservedRunningTime="2026-07-07 16:05:08.32181743 +0000 UTC m=+2104.346014700"
Jul 07 16:05:10.312432 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.312400    2573 generic.go:356] "Generic (PLEG): container finished" podID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerID="b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868" exitCode=0
Jul 07 16:05:10.312788 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.312457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerDied","Data":"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"}
Jul 07 16:05:10.312918 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.312900    2573 scope.go:117] "RemoveContainer" containerID="b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"
Jul 07 16:05:10.313942 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.313913    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:10.314004 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.313984    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:10.314043 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.314013    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:10.743469 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:10.743428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:11.318649 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:11.318614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerStarted","Data":"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"}
Jul 07 16:05:11.759710 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:11.759669    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:05:11.761004 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:11.760966    2573 patch_prober.go:28] interesting pod/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 16:05:11.761157 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:11.761042    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 16:05:12.213112 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:12.212987    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:05:12.760355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:12.760307    2573 patch_prober.go:28] interesting pod/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 16:05:12.760877 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:12.760378    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 16:05:13.763092 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:13.762459    2573 patch_prober.go:28] interesting pod/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 16:05:13.763092 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:13.762524    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 16:05:14.312902 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:14.312874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:05:14.760532 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:14.760485    2573 patch_prober.go:28] interesting pod/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 16:05:14.760808 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:14.760585    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 16:05:15.764010 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:15.763978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:05:15.765159 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:15.765141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:05:18.355670 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.355593    2573 generic.go:356] "Generic (PLEG): container finished" podID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerID="1340f09e361d3f902df928a1bb3142fdfb211c0fb80b10e34f549fb8ba84ec40" exitCode=0
Jul 07 16:05:18.356101 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.355675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerDied","Data":"1340f09e361d3f902df928a1bb3142fdfb211c0fb80b10e34f549fb8ba84ec40"}
Jul 07 16:05:18.356198 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.356183    2573 scope.go:117] "RemoveContainer" containerID="1340f09e361d3f902df928a1bb3142fdfb211c0fb80b10e34f549fb8ba84ec40"
Jul 07 16:05:18.357226 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.357201    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:18.357298 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.357263    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:18.357334 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:18.357312    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 16:05:19.365455 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.365411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerStarted","Data":"34fed7e014bbf38658ebf7a5ffc932a96decb1cc263a2b383cf923cb4b7ab9b3"}
Jul 07 16:05:19.604101 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.604052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:19.605147 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.605124    2573 patch_prober.go:28] interesting pod/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 16:05:19.605256 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.605171    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 16:05:19.864085 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.864027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:19.965118 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:19.965081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:20.279809 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:20.279775    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:20.604532 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:20.604447    2573 patch_prober.go:28] interesting pod/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 16:05:20.604532 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:20.604497    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 16:05:21.604169 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:21.604129    2573 patch_prober.go:28] interesting pod/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 16:05:21.604384 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:21.604190    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 16:05:22.604874 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:22.604847    2573 patch_prober.go:28] interesting pod/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 16:05:22.605337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:22.605311    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 16:05:23.607904 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:23.607876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:23.608893 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:23.608874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:05:26.337187 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:26.337143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:28.066855 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:28.066812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:28.168986 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:28.168906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:47.915819 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.915782    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:05:47.918653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.918635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:47.922051 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.922022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"auth-test-model-82510b-kserve-self-signed-certs\""
Jul 07 16:05:47.922194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.922058    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"kube-root-ca.crt\""
Jul 07 16:05:47.922194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.922107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"default-dockercfg-7cb8j\""
Jul 07 16:05:47.922194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.922115    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"openshift-service-ca.crt\""
Jul 07 16:05:47.929723 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.929706    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:05:47.940833 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:47.940809    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:05:48.033336 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.033509 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.033509 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.033509 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.033629 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsxqc\" (UniqueName: \"kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.033629 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.033532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134777 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134982 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134982 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134982 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134982 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsxqc\" (UniqueName: \"kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.134982 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.134907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.135279 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.135254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.135338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.135262    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.135338 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.135312    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.137419 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.137390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.137702 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.137681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.143856 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.143832    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsxqc\" (UniqueName: \"kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc\") pod \"auth-test-model-82510b-kserve-7db5c744c-gx944\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") " pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.228142 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.228119    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:48.388554 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.388529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:05:48.390692 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:05:48.390663    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60ced81_6f79_464f_abc9_bd4e62699fba.slice/crio-9fae3323745ccd39f52324e35eae7d348e961517d7587e1a5c0ebcdbe3a5ddfe WatchSource:0}: Error finding container 9fae3323745ccd39f52324e35eae7d348e961517d7587e1a5c0ebcdbe3a5ddfe: Status 404 returned error can't find the container with id 9fae3323745ccd39f52324e35eae7d348e961517d7587e1a5c0ebcdbe3a5ddfe
Jul 07 16:05:48.515354 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.515266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" event={"ID":"e60ced81-6f79-464f-abc9-bd4e62699fba","Type":"ContainerStarted","Data":"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"}
Jul 07 16:05:48.515354 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.515318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" event={"ID":"e60ced81-6f79-464f-abc9-bd4e62699fba","Type":"ContainerStarted","Data":"9fae3323745ccd39f52324e35eae7d348e961517d7587e1a5c0ebcdbe3a5ddfe"}
Jul 07 16:05:48.536600 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:48.536546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" podStartSLOduration=1.53653012 podStartE2EDuration="1.53653012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:48.533790249 +0000 UTC m=+2144.557987520" watchObservedRunningTime="2026-07-07 16:05:48.53653012 +0000 UTC m=+2144.560727417"
Jul 07 16:05:58.228341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:58.228253    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:58.228341 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:58.228313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:58.241148 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:58.241123    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:05:58.577468 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:05:58.577388    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:06:04.724753 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:06:04.724719    2573 scope.go:117] "RemoveContainer" containerID="2133997d1606d830a1d54cfc93b5d77e10756864f3e49949d6f896455256aee7"
Jul 07 16:06:04.746847 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:06:04.746819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:06:47.004310 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:06:47.004269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:06:52.687175 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:06:52.687135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:07:42.650541 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:42.650436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:07:43.491859 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:43.491828    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:07:44.237595 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:44.237556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:07:52.331395 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:52.331359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:07:58.512467 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.512424    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerName="main" containerID="cri-o://9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f" gracePeriod=45
Jul 07 16:07:58.566980 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.566938    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": dial tcp 10.134.0.59:8000: connect: connection refused"
Jul 07 16:07:58.764863 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.764806    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:07:58.879150 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879103    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsxqc\" (UniqueName: \"kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879355 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home\") pod \"e60ced81-6f79-464f-abc9-bd4e62699fba\" (UID: \"e60ced81-6f79-464f-abc9-bd4e62699fba\") "
Jul 07 16:07:58.879633 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879508    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.879633 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879539    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache" (OuterVolumeSpecName: "model-cache") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.879716 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879699    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-tmp-dir\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.879716 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879694    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home" (OuterVolumeSpecName: "home") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.879716 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.879713    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-model-cache\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.881536 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.881512    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc" (OuterVolumeSpecName: "kube-api-access-zsxqc") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "kube-api-access-zsxqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:07:58.881536 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.881518    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm" (OuterVolumeSpecName: "dshm") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.881536 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.881527    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e60ced81-6f79-464f-abc9-bd4e62699fba" (UID: "e60ced81-6f79-464f-abc9-bd4e62699fba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:07:58.980820 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.980786    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e60ced81-6f79-464f-abc9-bd4e62699fba-tls-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.980820 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.980812    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-dshm\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.980820 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.980820    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e60ced81-6f79-464f-abc9-bd4e62699fba-home\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.981031 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:58.980828    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsxqc\" (UniqueName: \"kubernetes.io/projected/e60ced81-6f79-464f-abc9-bd4e62699fba-kube-api-access-zsxqc\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:07:59.148309 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.148225    2573 generic.go:356] "Generic (PLEG): container finished" podID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerID="9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f" exitCode=0
Jul 07 16:07:59.148309 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.148272    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"
Jul 07 16:07:59.148492 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.148310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" event={"ID":"e60ced81-6f79-464f-abc9-bd4e62699fba","Type":"ContainerDied","Data":"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"}
Jul 07 16:07:59.148492 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.148363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944" event={"ID":"e60ced81-6f79-464f-abc9-bd4e62699fba","Type":"ContainerDied","Data":"9fae3323745ccd39f52324e35eae7d348e961517d7587e1a5c0ebcdbe3a5ddfe"}
Jul 07 16:07:59.148492 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.148380    2573 scope.go:117] "RemoveContainer" containerID="9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"
Jul 07 16:07:59.157984 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.157964    2573 scope.go:117] "RemoveContainer" containerID="9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"
Jul 07 16:07:59.160808 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:07:59.160785    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f\": container with ID starting with 9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f not found: ID does not exist" containerID="9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"
Jul 07 16:07:59.160973 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.160946    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f"} err="failed to get container status \"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f\": rpc error: code = NotFound desc = could not find container \"9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f\": container with ID starting with 9ba2970f023827a0f1b9b8cbe667010417992e53334cc5ea3932d33177aab93f not found: ID does not exist"
Jul 07 16:07:59.171247 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.171221    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:07:59.177413 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:07:59.177393    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/auth-test-model-82510b-kserve-7db5c744c-gx944"]
Jul 07 16:08:00.597943 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:00.597909    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" path="/var/lib/kubelet/pods/e60ced81-6f79-464f-abc9-bd4e62699fba/volumes"
Jul 07 16:08:32.638669 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:32.638630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:08:32.785218 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:32.785176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:08:33.643374 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.643344    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:08:33.643742 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.643720    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerName="main"
Jul 07 16:08:33.643742 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.643731    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerName="main"
Jul 07 16:08:33.643818 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.643798    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60ced81-6f79-464f-abc9-bd4e62699fba" containerName="main"
Jul 07 16:08:33.646534 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.646513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.651160 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.651140    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"openshift-service-ca.crt\""
Jul 07 16:08:33.652218 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.652196    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"sub-test-model-82510b-kserve-self-signed-certs\""
Jul 07 16:08:33.652333 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.652226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"default-dockercfg-7cb8j\""
Jul 07 16:08:33.652333 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.652233    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"kube-root-ca.crt\""
Jul 07 16:08:33.675470 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.675437    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:08:33.691043 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.691014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:08:33.699829 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.699927 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699866    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.699927 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.699927 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.700033 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mg5m\" (UniqueName: \"kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.700033 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.699952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801428 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mg5m\" (UniqueName: \"kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.801948 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801928    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.802012 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.801991    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.802082 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.802008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.803926 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.803898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.804107 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.804091    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.810161 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.810135    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mg5m\" (UniqueName: \"kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m\") pod \"sub-test-model-82510b-kserve-569bffddb7-mjp72\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") " pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:33.956955 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:33.956864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:34.094429 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:34.094365    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:08:34.097804 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:08:34.097773    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02239df6_2540_4c6d_899e_d3c4f93f8879.slice/crio-9a667c38540671ab05a0b41bc31911af414c42a1005e0f7633c9a2ea2af91574 WatchSource:0}: Error finding container 9a667c38540671ab05a0b41bc31911af414c42a1005e0f7633c9a2ea2af91574: Status 404 returned error can't find the container with id 9a667c38540671ab05a0b41bc31911af414c42a1005e0f7633c9a2ea2af91574
Jul 07 16:08:34.326193 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:34.326156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" event={"ID":"02239df6-2540-4c6d-899e-d3c4f93f8879","Type":"ContainerStarted","Data":"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"}
Jul 07 16:08:34.326380 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:34.326206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" event={"ID":"02239df6-2540-4c6d-899e-d3c4f93f8879","Type":"ContainerStarted","Data":"9a667c38540671ab05a0b41bc31911af414c42a1005e0f7633c9a2ea2af91574"}
Jul 07 16:08:34.347455 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:34.347406    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" podStartSLOduration=1.347378855 podStartE2EDuration="1.347378855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:08:34.346335792 +0000 UTC m=+2310.370533065" watchObservedRunningTime="2026-07-07 16:08:34.347378855 +0000 UTC m=+2310.371576125"
Jul 07 16:08:43.957014 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:43.956972    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:43.957543 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:43.957032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:43.970188 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:43.970163    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:44.386493 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:44.386462    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:08:57.558111 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:08:57.557997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:09.848948 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:09.848910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:34.962560 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:34.962524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:35.730163 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:35.730128    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:09:35.750396 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:35.750363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:39.768945 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:39.768905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:39.869738 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:39.869702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:43.848914 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:43.848877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:09:50.750487 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:50.750446    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" podUID="02239df6-2540-4c6d-899e-d3c4f93f8879" containerName="main" containerID="cri-o://9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c" gracePeriod=45
Jul 07 16:09:51.010890 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.010824    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:09:51.132444 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132415    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132454    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132600    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132637    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132857 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132696    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:51.132857 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132723    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mg5m\" (UniqueName: \"kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m\") pod \"02239df6-2540-4c6d-899e-d3c4f93f8879\" (UID: \"02239df6-2540-4c6d-899e-d3c4f93f8879\") "
Jul 07 16:09:51.132857 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132839    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home" (OuterVolumeSpecName: "home") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:51.133009 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.132852    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache" (OuterVolumeSpecName: "model-cache") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:51.133114 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.133094    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-tmp-dir\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.133177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.133120    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-home\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.133177 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.133134    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-model-cache\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.134855 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.134822    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm" (OuterVolumeSpecName: "dshm") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:51.134967 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.134916    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:09:51.134967 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.134933    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m" (OuterVolumeSpecName: "kube-api-access-7mg5m") pod "02239df6-2540-4c6d-899e-d3c4f93f8879" (UID: "02239df6-2540-4c6d-899e-d3c4f93f8879"). InnerVolumeSpecName "kube-api-access-7mg5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:09:51.233863 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.233831    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02239df6-2540-4c6d-899e-d3c4f93f8879-tls-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.233863 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.233858    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02239df6-2540-4c6d-899e-d3c4f93f8879-dshm\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.233863 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.233868    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mg5m\" (UniqueName: \"kubernetes.io/projected/02239df6-2540-4c6d-899e-d3c4f93f8879-kube-api-access-7mg5m\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.713665 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.713629    2573 generic.go:356] "Generic (PLEG): container finished" podID="02239df6-2540-4c6d-899e-d3c4f93f8879" containerID="9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c" exitCode=0
Jul 07 16:09:51.713872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.713677    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"
Jul 07 16:09:51.713872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.713695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" event={"ID":"02239df6-2540-4c6d-899e-d3c4f93f8879","Type":"ContainerDied","Data":"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"}
Jul 07 16:09:51.713872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.713743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72" event={"ID":"02239df6-2540-4c6d-899e-d3c4f93f8879","Type":"ContainerDied","Data":"9a667c38540671ab05a0b41bc31911af414c42a1005e0f7633c9a2ea2af91574"}
Jul 07 16:09:51.713872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.713768    2573 scope.go:117] "RemoveContainer" containerID="9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"
Jul 07 16:09:51.723970 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.723953    2573 scope.go:117] "RemoveContainer" containerID="9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"
Jul 07 16:09:51.724263 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:09:51.724238    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c\": container with ID starting with 9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c not found: ID does not exist" containerID="9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"
Jul 07 16:09:51.724332 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.724277    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c"} err="failed to get container status \"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c\": rpc error: code = NotFound desc = could not find container \"9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c\": container with ID starting with 9624bf3aff612140b540dfc12455860396633ebbca0c1c5abc5f0c9e45eabd2c not found: ID does not exist"
Jul 07 16:09:51.742279 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.742258    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:09:51.745380 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:51.745360    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/sub-test-model-82510b-kserve-569bffddb7-mjp72"]
Jul 07 16:09:52.597591 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:09:52.597560    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02239df6-2540-4c6d-899e-d3c4f93f8879" path="/var/lib/kubelet/pods/02239df6-2540-4c6d-899e-d3c4f93f8879/volumes"
Jul 07 16:10:04.642001 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:04.641977    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:10:04.645697 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:04.645677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hg4wb_4039bdc1-b377-47c8-bcc3-fb61ace25c28/ovn-acl-logging/0.log"
Jul 07 16:10:14.427493 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.427461    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:10:14.427880 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.427854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02239df6-2540-4c6d-899e-d3c4f93f8879" containerName="main"
Jul 07 16:10:14.427880 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.427865    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02239df6-2540-4c6d-899e-d3c4f93f8879" containerName="main"
Jul 07 16:10:14.427951 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.427932    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02239df6-2540-4c6d-899e-d3c4f93f8879" containerName="main"
Jul 07 16:10:14.430316 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.430300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.433238 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.433216    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"openshift-service-ca.crt\""
Jul 07 16:10:14.434145 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.434126    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"kube-root-ca.crt\""
Jul 07 16:10:14.434239 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.434175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"rate-test-model-82510b-kserve-self-signed-certs\""
Jul 07 16:10:14.434239 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.434192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82510b\"/\"default-dockercfg-7cb8j\""
Jul 07 16:10:14.448335 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.448304    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:10:14.457163 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.457136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:14.547552 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.547707 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.547707 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.547707 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.547707 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w72rh\" (UniqueName: \"kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.547843 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.547711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.648862 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.648832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.648868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.648897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.648913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w72rh\" (UniqueName: \"kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649020 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.648948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649287 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.649028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649287 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.649276    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649468 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.649442    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.649601 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.649567    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.651474 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.651448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.651825 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.651768    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.658670 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.658644    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w72rh\" (UniqueName: \"kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh\") pod \"rate-test-model-82510b-kserve-595dc568b7-xvtp8\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") " pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.746697 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.746663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:14.889652 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:14.889628    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:10:14.891675 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:10:14.891648    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf0b4eaf_206b_481d_8bd8_4a78c11c6b9c.slice/crio-9011ec8517f92c5903d3abec1b0f47f22a8dae2baf7f4f84e315fcf85b7f9bd2 WatchSource:0}: Error finding container 9011ec8517f92c5903d3abec1b0f47f22a8dae2baf7f4f84e315fcf85b7f9bd2: Status 404 returned error can't find the container with id 9011ec8517f92c5903d3abec1b0f47f22a8dae2baf7f4f84e315fcf85b7f9bd2
Jul 07 16:10:15.835365 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:15.835323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" event={"ID":"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c","Type":"ContainerStarted","Data":"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"}
Jul 07 16:10:15.835740 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:15.835374    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" event={"ID":"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c","Type":"ContainerStarted","Data":"9011ec8517f92c5903d3abec1b0f47f22a8dae2baf7f4f84e315fcf85b7f9bd2"}
Jul 07 16:10:15.855805 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:15.855752    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" podStartSLOduration=1.855731977 podStartE2EDuration="1.855731977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:15.854285258 +0000 UTC m=+2411.878482532" watchObservedRunningTime="2026-07-07 16:10:15.855731977 +0000 UTC m=+2411.879929247"
Jul 07 16:10:20.628576 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:20.628539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:20.729490 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:20.729456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:24.747872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:24.747786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:24.747872 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:24.747838    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:24.760411 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:24.760386    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:24.890358 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:24.890331    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:10:28.814619 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:28.814581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:28.917280 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:28.917233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:56.155041 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:56.155011    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:56.728626 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:56.728587    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:10:56.743640 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:56.743609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:57.901721 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:57.901687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:58.332489 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:58.332459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:58.668927 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:58.668832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:58.770273 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:58.770235    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:58.975577 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:58.975493    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:10:58.976016 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:58.975776    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" podUID="bdded68c-8abf-4bc7-aa1d-603b42197c59" containerName="maas-api" containerID="cri-o://28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c" gracePeriod=30
Jul 07 16:10:59.004012 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.003989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:10:59.220182 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.220159    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:10:59.303481 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.303449    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls\") pod \"bdded68c-8abf-4bc7-aa1d-603b42197c59\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") "
Jul 07 16:10:59.303647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.303525    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca\") pod \"bdded68c-8abf-4bc7-aa1d-603b42197c59\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") "
Jul 07 16:10:59.303647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.303561    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q7l7\" (UniqueName: \"kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7\") pod \"bdded68c-8abf-4bc7-aa1d-603b42197c59\" (UID: \"bdded68c-8abf-4bc7-aa1d-603b42197c59\") "
Jul 07 16:10:59.303899 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.303870    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bdded68c-8abf-4bc7-aa1d-603b42197c59" (UID: "bdded68c-8abf-4bc7-aa1d-603b42197c59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:10:59.305756 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.305729    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bdded68c-8abf-4bc7-aa1d-603b42197c59" (UID: "bdded68c-8abf-4bc7-aa1d-603b42197c59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:10:59.305756 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.305729    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7" (OuterVolumeSpecName: "kube-api-access-5q7l7") pod "bdded68c-8abf-4bc7-aa1d-603b42197c59" (UID: "bdded68c-8abf-4bc7-aa1d-603b42197c59"). InnerVolumeSpecName "kube-api-access-5q7l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:10:59.404737 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.404697    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdded68c-8abf-4bc7-aa1d-603b42197c59-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:10:59.404737 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.404730    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdded68c-8abf-4bc7-aa1d-603b42197c59-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:10:59.404737 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:10:59.404744    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q7l7\" (UniqueName: \"kubernetes.io/projected/bdded68c-8abf-4bc7-aa1d-603b42197c59-kube-api-access-5q7l7\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:00.046007 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.045966    2573 generic.go:356] "Generic (PLEG): container finished" podID="bdded68c-8abf-4bc7-aa1d-603b42197c59" containerID="28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c" exitCode=0
Jul 07 16:11:00.046426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.046012    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"
Jul 07 16:11:00.046426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.046060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" event={"ID":"bdded68c-8abf-4bc7-aa1d-603b42197c59","Type":"ContainerDied","Data":"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"}
Jul 07 16:11:00.046426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.046136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk" event={"ID":"bdded68c-8abf-4bc7-aa1d-603b42197c59","Type":"ContainerDied","Data":"6f5a2d3fbb6af2f19fde3967cba2ba4d9fe51f287c066a19f3f8f6d231d68c78"}
Jul 07 16:11:00.046426 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.046159    2573 scope.go:117] "RemoveContainer" containerID="28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"
Jul 07 16:11:00.058220 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.058203    2573 scope.go:117] "RemoveContainer" containerID="28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"
Jul 07 16:11:00.058460 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:11:00.058442    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c\": container with ID starting with 28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c not found: ID does not exist" containerID="28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"
Jul 07 16:11:00.058501 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.058475    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c"} err="failed to get container status \"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c\": rpc error: code = NotFound desc = could not find container \"28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c\": container with ID starting with 28edb7ea8579f598b76f4cab3044f8a90444fc3c6122c7d4276a6729d0d8885c not found: ID does not exist"
Jul 07 16:11:00.074835 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.074811    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:11:00.087256 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.087232    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4e777d-ff67b9ff6-p2whk"]
Jul 07 16:11:00.598286 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:00.598251    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdded68c-8abf-4bc7-aa1d-603b42197c59" path="/var/lib/kubelet/pods/bdded68c-8abf-4bc7-aa1d-603b42197c59/volumes"
Jul 07 16:11:03.374057 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:03.374021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:11.748967 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:11.748908    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" podUID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" containerName="main" containerID="cri-o://8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98" gracePeriod=45
Jul 07 16:11:12.010252 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.010193    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:11:12.022028 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.021994    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022120    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022146 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022261 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022175    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w72rh\" (UniqueName: \"kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022261 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs\") pod \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\" (UID: \"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c\") "
Jul 07 16:11:12.022362 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022273    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:12.022418 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022344    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home" (OuterVolumeSpecName: "home") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:12.022474 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022418    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:12.022533 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022513    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tmp-dir\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.022589 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022531    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-home\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.022589 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.022545    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-model-cache\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.024337 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.024311    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:11:12.024493 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.024468    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh" (OuterVolumeSpecName: "kube-api-access-w72rh") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "kube-api-access-w72rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:12.024541 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.024494    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm" (OuterVolumeSpecName: "dshm") pod "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" (UID: "af0b4eaf-206b-481d-8bd8-4a78c11c6b9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:12.104494 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.104460    2573 generic.go:356] "Generic (PLEG): container finished" podID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" containerID="8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98" exitCode=0
Jul 07 16:11:12.104686 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.104508    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"
Jul 07 16:11:12.104686 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.104554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" event={"ID":"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c","Type":"ContainerDied","Data":"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"}
Jul 07 16:11:12.104686 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.104603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8" event={"ID":"af0b4eaf-206b-481d-8bd8-4a78c11c6b9c","Type":"ContainerDied","Data":"9011ec8517f92c5903d3abec1b0f47f22a8dae2baf7f4f84e315fcf85b7f9bd2"}
Jul 07 16:11:12.104686 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.104636    2573 scope.go:117] "RemoveContainer" containerID="8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"
Jul 07 16:11:12.113843 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.113827    2573 scope.go:117] "RemoveContainer" containerID="8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"
Jul 07 16:11:12.114104 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:11:12.114086    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98\": container with ID starting with 8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98 not found: ID does not exist" containerID="8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"
Jul 07 16:11:12.114152 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.114112    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98"} err="failed to get container status \"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98\": rpc error: code = NotFound desc = could not find container \"8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98\": container with ID starting with 8def2b721dde27de4d6c33fdf081056503ead4151745080eee6e9a756da67f98 not found: ID does not exist"
Jul 07 16:11:12.123326 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.123306    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-dshm\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.123421 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.123327    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w72rh\" (UniqueName: \"kubernetes.io/projected/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-kube-api-access-w72rh\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.123421 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.123342    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c-tls-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:12.127470 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.127449    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:11:12.131925 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.131904    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82510b/rate-test-model-82510b-kserve-595dc568b7-xvtp8"]
Jul 07 16:11:12.598653 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:12.598617    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" path="/var/lib/kubelet/pods/af0b4eaf-206b-481d-8bd8-4a78c11c6b9c/volumes"
Jul 07 16:11:22.814182 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:22.814139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:23.090007 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:23.089918    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:11:23.090243 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:23.090215    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy" containerID="cri-o://3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738" gracePeriod=30
Jul 07 16:11:23.182127 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:23.182091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:23.395153 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:23.395043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:23.760328 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:23.760287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:24.148776 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.148692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:24.353412 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.353383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:24.451312 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.451216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:24.582469 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.582439    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:11:24.582704 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.582675    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" podUID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" containerName="maas-api" containerID="cri-o://81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705" gracePeriod=30
Jul 07 16:11:24.664918 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.664884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:24.829351 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.829328    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:11:24.951519 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.951487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24vds\" (UniqueName: \"kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds\") pod \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") "
Jul 07 16:11:24.951689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.951547    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") pod \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") "
Jul 07 16:11:24.951689 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.951573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca\") pod \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\" (UID: \"51ba122a-5ab6-4ab5-88fb-0f2406525a2d\") "
Jul 07 16:11:24.952039 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.951991    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51ba122a-5ab6-4ab5-88fb-0f2406525a2d" (UID: "51ba122a-5ab6-4ab5-88fb-0f2406525a2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:11:24.953818 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.953792    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds" (OuterVolumeSpecName: "kube-api-access-24vds") pod "51ba122a-5ab6-4ab5-88fb-0f2406525a2d" (UID: "51ba122a-5ab6-4ab5-88fb-0f2406525a2d"). InnerVolumeSpecName "kube-api-access-24vds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:24.953976 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:24.953878    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51ba122a-5ab6-4ab5-88fb-0f2406525a2d" (UID: "51ba122a-5ab6-4ab5-88fb-0f2406525a2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:11:25.052851 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.052763    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24vds\" (UniqueName: \"kubernetes.io/projected/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-kube-api-access-24vds\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:25.052851 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.052790    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-maas-api-tls\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:25.052851 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.052800    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ba122a-5ab6-4ab5-88fb-0f2406525a2d-openshift-service-ca\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:25.168081 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.168037    2573 generic.go:356] "Generic (PLEG): container finished" podID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" containerID="81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705" exitCode=0
Jul 07 16:11:25.168530 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.168102    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"
Jul 07 16:11:25.168530 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.168121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" event={"ID":"51ba122a-5ab6-4ab5-88fb-0f2406525a2d","Type":"ContainerDied","Data":"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"}
Jul 07 16:11:25.168530 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.168183    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj" event={"ID":"51ba122a-5ab6-4ab5-88fb-0f2406525a2d","Type":"ContainerDied","Data":"b383f9d09cf916f12f82b1c7b17e99c4164fa865bb44cab23c1485fa06e12f59"}
Jul 07 16:11:25.168530 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.168218    2573 scope.go:117] "RemoveContainer" containerID="81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"
Jul 07 16:11:25.177925 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.177907    2573 scope.go:117] "RemoveContainer" containerID="81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"
Jul 07 16:11:25.178175 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:11:25.178159    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705\": container with ID starting with 81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705 not found: ID does not exist" containerID="81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"
Jul 07 16:11:25.178270 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.178186    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705"} err="failed to get container status \"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705\": rpc error: code = NotFound desc = could not find container \"81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705\": container with ID starting with 81505b76dc48b7397d46c42a6cde6cd1db98916d0c6f85e44ad8c8296f6ef705 not found: ID does not exist"
Jul 07 16:11:25.190799 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.190775    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:11:25.195947 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:25.195929    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-82510b-54577df9df-487kj"]
Jul 07 16:11:26.598217 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:26.598182    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" path="/var/lib/kubelet/pods/51ba122a-5ab6-4ab5-88fb-0f2406525a2d/volumes"
Jul 07 16:11:28.343933 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.343908    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:11:28.484926 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.484897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.484932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.484974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.484996    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485018    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlgmm\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485135 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485129    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485201    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo\") pod \"e928fcca-d78c-44db-b197-cbc143ae5c36\" (UID: \"e928fcca-d78c-44db-b197-cbc143ae5c36\") "
Jul 07 16:11:28.485459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485349    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:28.485459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485368    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:28.485459 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485429    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:28.485724 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485469    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:11:28.485789 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485721    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.485789 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485741    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.485789 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485753    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e928fcca-d78c-44db-b197-cbc143ae5c36-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.485789 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.485766    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.486224 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.486203    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data" (OuterVolumeSpecName: "istio-data") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:28.487550 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.487526    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:11:28.487658 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.487598    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:28.487769 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.487756    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token" (OuterVolumeSpecName: "istio-token") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:28.487849 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.487830    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm" (OuterVolumeSpecName: "kube-api-access-mlgmm") pod "e928fcca-d78c-44db-b197-cbc143ae5c36" (UID: "e928fcca-d78c-44db-b197-cbc143ae5c36"). InnerVolumeSpecName "kube-api-access-mlgmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:28.586289 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.586261    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.586289 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.586286    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.586289 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.586295    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.586534 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.586303    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlgmm\" (UniqueName: \"kubernetes.io/projected/e928fcca-d78c-44db-b197-cbc143ae5c36-kube-api-access-mlgmm\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:28.586534 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:28.586313    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e928fcca-d78c-44db-b197-cbc143ae5c36-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:29.189622 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.189585    2573 generic.go:356] "Generic (PLEG): container finished" podID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerID="3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738" exitCode=0
Jul 07 16:11:29.189829 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.189651    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"
Jul 07 16:11:29.189829 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.189676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerDied","Data":"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"}
Jul 07 16:11:29.189829 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.189746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58" event={"ID":"e928fcca-d78c-44db-b197-cbc143ae5c36","Type":"ContainerDied","Data":"652143d9f339149f0987c2a031a97704a5d71291b5b5e93d49052c8b370670f4"}
Jul 07 16:11:29.189829 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.189778    2573 scope.go:117] "RemoveContainer" containerID="3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"
Jul 07 16:11:29.198401 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.198387    2573 scope.go:117] "RemoveContainer" containerID="b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"
Jul 07 16:11:29.206587 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.206392    2573 scope.go:117] "RemoveContainer" containerID="3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"
Jul 07 16:11:29.206678 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:11:29.206658    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738\": container with ID starting with 3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738 not found: ID does not exist" containerID="3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"
Jul 07 16:11:29.206718 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.206693    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738"} err="failed to get container status \"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738\": rpc error: code = NotFound desc = could not find container \"3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738\": container with ID starting with 3846d8c8afc96e449989380b804e98a52cac41dc4942de0748dd6ef0a4dd3738 not found: ID does not exist"
Jul 07 16:11:29.206718 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.206708    2573 scope.go:117] "RemoveContainer" containerID="b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"
Jul 07 16:11:29.206958 ip-10-0-132-109 kubenswrapper[2573]: E0707 16:11:29.206940    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868\": container with ID starting with b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868 not found: ID does not exist" containerID="b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"
Jul 07 16:11:29.207001 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.206965    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868"} err="failed to get container status \"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868\": rpc error: code = NotFound desc = could not find container \"b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868\": container with ID starting with b632f7fc97b26c430184b453e1ee8fd7944712c63fbdedd8de1fc327f2914868 not found: ID does not exist"
Jul 07 16:11:29.212002 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.211981    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:11:29.220517 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:29.220497    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4e777d-openshift-default-7bfdf964d7-ctw58"]
Jul 07 16:11:30.598268 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:30.598235    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" path="/var/lib/kubelet/pods/e928fcca-d78c-44db-b197-cbc143ae5c36/volumes"
Jul 07 16:11:30.772701 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:30.772671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:30.851263 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:30.851164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:31.053567 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:31.053536    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:11:31.053795 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:31.053772    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy" containerID="cri-o://34fed7e014bbf38658ebf7a5ffc932a96decb1cc263a2b383cf923cb4b7ab9b3" gracePeriod=30
Jul 07 16:11:31.091710 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:31.091680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:31.372015 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:31.371979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:36.226272 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.226236    2573 generic.go:356] "Generic (PLEG): container finished" podID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerID="34fed7e014bbf38658ebf7a5ffc932a96decb1cc263a2b383cf923cb4b7ab9b3" exitCode=0
Jul 07 16:11:36.226690 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.226312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerDied","Data":"34fed7e014bbf38658ebf7a5ffc932a96decb1cc263a2b383cf923cb4b7ab9b3"}
Jul 07 16:11:36.226690 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.226416    2573 scope.go:117] "RemoveContainer" containerID="1340f09e361d3f902df928a1bb3142fdfb211c0fb80b10e34f549fb8ba84ec40"
Jul 07 16:11:36.299696 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.299671    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:11:36.464276 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464189    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464276 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464276 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464289    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464316    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464373    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464479    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw9tn\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464548 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464510    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data\") pod \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\" (UID: \"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec\") "
Jul 07 16:11:36.464852 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464696    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:36.464852 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464723    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:36.464852 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464739    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:11:36.465005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464888    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:36.465005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464936    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istiod-ca-cert\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.465005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464957    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.465005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.464972    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-workload-certs\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.465648 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.465624    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:36.466706 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.466686    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:11:36.466825 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.466720    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:36.467218 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.467197    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:36.467308 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.467221    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn" (OuterVolumeSpecName: "kube-api-access-gw9tn") pod "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" (UID: "0c00129c-f19e-471f-9c03-fbd9f7b2d3ec"). InnerVolumeSpecName "kube-api-access-gw9tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:36.565720 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565680    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-credential-socket\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.565720 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565715    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-token\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.565720 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565726    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw9tn\" (UniqueName: \"kubernetes.io/projected/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-kube-api-access-gw9tn\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.565949 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565735    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-data\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.565949 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565743    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-podinfo\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.565949 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.565751    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec-istio-envoy\") on node \"ip-10-0-132-109.ec2.internal\" DevicePath \"\""
Jul 07 16:11:36.818943 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.818905    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zxrxw_3665dfd5-7a1f-43b3-a395-db380544ecb4/manager/0.log"
Jul 07 16:11:36.954281 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:36.954252    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6j5bm_676cf42b-ee17-402f-a7a0-5472686f2f55/manager/0.log"
Jul 07 16:11:37.192385 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.192297    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723985-mp4lp_fdb6b012-fecc-40a1-909a-88cccb7981ad/cleanup/0.log"
Jul 07 16:11:37.232482 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.232458    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"
Jul 07 16:11:37.232834 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.232498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8" event={"ID":"0c00129c-f19e-471f-9c03-fbd9f7b2d3ec","Type":"ContainerDied","Data":"57fb4d58ee4f7d29fece73a71a984ab80176dce18fee631c55a5476b6a380872"}
Jul 07 16:11:37.232834 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.232556    2573 scope.go:117] "RemoveContainer" containerID="34fed7e014bbf38658ebf7a5ffc932a96decb1cc263a2b383cf923cb4b7ab9b3"
Jul 07 16:11:37.252371 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.252345    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:11:37.256760 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.256739    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-82510b-openshift-default-5b559455d7-djqh8"]
Jul 07 16:11:37.307117 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.307093    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724000-fhmwd_603475ac-5924-4c28-b0f7-367c6a5664bc/cleanup/0.log"
Jul 07 16:11:37.440641 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.440588    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f76876c5d-82g62_7423520e-8be9-4909-bd7f-a1e94e0666cd/manager/0.log"
Jul 07 16:11:37.991870 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:37.991842    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-ml5r5_e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed/copy-manifests/0.log"
Jul 07 16:11:38.014404 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:38.014373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-ml5r5_e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed/manager/0.log"
Jul 07 16:11:38.597415 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:38.597382    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" path="/var/lib/kubelet/pods/0c00129c-f19e-471f-9c03-fbd9f7b2d3ec/volumes"
Jul 07 16:11:40.621528 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:40.621497    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wvkln_7caa282c-fc6f-40fd-9cea-b2c294b9a416/manager/0.log"
Jul 07 16:11:40.982224 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:40.982190    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hl5rd_c18eae91-3bb2-498e-97a4-7337ae5a6012/istio-proxy/0.log"
Jul 07 16:11:41.486597 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:41.486564    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/1.log"
Jul 07 16:11:41.624828 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:41.624803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2vdph_f30ae3ef-146b-4b6c-be65-4469c383cc75/payload-pre-processing/0.log"
Jul 07 16:11:42.251822 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:42.251797    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sfdqt_60d7e738-82a9-4c8a-bf05-d480ef0c6444/main/0.log"
Jul 07 16:11:42.761281 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:42.761253    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pcmcj_62ee50a6-58fe-4242-ab3f-06afdabc4811/main/0.log"
Jul 07 16:11:47.847577 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:47.847540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:47.938647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:47.938593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log" limit=1024
Jul 07 16:11:50.908956 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:50.908920    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8gfbn_c1d63266-f946-42f2-830c-9aa08621d127/global-pull-secret-syncer/0.log"
Jul 07 16:11:51.067461 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:51.067427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-84nxm_8c03398b-e577-4d2d-a6fc-ed22dbc34ba5/konnectivity-agent/0.log"
Jul 07 16:11:51.215334 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:51.215250    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-109.ec2.internal_d8f27341c4c149835f7420faa8e8961a/haproxy/0.log"
Jul 07 16:11:56.957345 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:56.957242    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wvkln_7caa282c-fc6f-40fd-9cea-b2c294b9a416/manager/0.log"
Jul 07 16:11:58.878416 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:58.878340    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-2r85g_ac632044-97a4-4d4b-927a-9e178525ed1e/cluster-monitoring-operator/0.log"
Jul 07 16:11:59.170212 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.170138    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqgwr_6166dad2-3d10-4cc4-86bb-a07c8270514f/node-exporter/0.log"
Jul 07 16:11:59.199623 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.199597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqgwr_6166dad2-3d10-4cc4-86bb-a07c8270514f/kube-rbac-proxy/0.log"
Jul 07 16:11:59.226199 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.226179    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqgwr_6166dad2-3d10-4cc4-86bb-a07c8270514f/init-textfile/0.log"
Jul 07 16:11:59.451384 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.451293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/prometheus/0.log"
Jul 07 16:11:59.480869 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.480844    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/config-reloader/0.log"
Jul 07 16:11:59.508474 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.508451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/thanos-sidecar/0.log"
Jul 07 16:11:59.541334 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.541313    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/kube-rbac-proxy-web/0.log"
Jul 07 16:11:59.582084 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.582039    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/kube-rbac-proxy/0.log"
Jul 07 16:11:59.613469 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.613444    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/kube-rbac-proxy-thanos/0.log"
Jul 07 16:11:59.644767 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.644737    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4597041b-c510-4450-8198-54d59a39dcb4/init-config-reloader/0.log"
Jul 07 16:11:59.763490 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.763462    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77b79cf6bd-nvdks_3e66a81e-5995-45e3-bf7c-9452c90d6c25/telemeter-client/0.log"
Jul 07 16:11:59.794452 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.794422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77b79cf6bd-nvdks_3e66a81e-5995-45e3-bf7c-9452c90d6c25/reload/0.log"
Jul 07 16:11:59.818743 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:11:59.818722    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77b79cf6bd-nvdks_3e66a81e-5995-45e3-bf7c-9452c90d6c25/kube-rbac-proxy/0.log"
Jul 07 16:12:00.551331 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551302    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"]
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551639    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdded68c-8abf-4bc7-aa1d-603b42197c59" containerName="maas-api"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551650    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdded68c-8abf-4bc7-aa1d-603b42197c59" containerName="maas-api"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551658    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" containerName="main"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551663    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" containerName="main"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551673    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551679    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551687    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551693    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551705 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551708    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" containerName="maas-api"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551714    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" containerName="maas-api"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551721    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551726    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551777    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e928fcca-d78c-44db-b197-cbc143ae5c36" containerName="istio-proxy"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551785    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551792    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c00129c-f19e-471f-9c03-fbd9f7b2d3ec" containerName="istio-proxy"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551799    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ba122a-5ab6-4ab5-88fb-0f2406525a2d" containerName="maas-api"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551804    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0b4eaf-206b-481d-8bd8-4a78c11c6b9c" containerName="main"
Jul 07 16:12:00.551997 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.551809    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdded68c-8abf-4bc7-aa1d-603b42197c59" containerName="maas-api"
Jul 07 16:12:00.554935 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.554916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.557924 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.557906    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"kube-root-ca.crt\""
Jul 07 16:12:00.558051 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.557907    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pxzwv\"/\"default-dockercfg-2rm5d\""
Jul 07 16:12:00.558636 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.558615    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"openshift-service-ca.crt\""
Jul 07 16:12:00.563194 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.563176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"]
Jul 07 16:12:00.676885 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.676853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwl6h\" (UniqueName: \"kubernetes.io/projected/99f86832-f1fd-4e9b-ab7e-61e1982c3001-kube-api-access-nwl6h\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.676885 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.676884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-sys\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.677183 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.676903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-proc\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.677183 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.677037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-podres\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.677183 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.677105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-lib-modules\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778439 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwl6h\" (UniqueName: \"kubernetes.io/projected/99f86832-f1fd-4e9b-ab7e-61e1982c3001-kube-api-access-nwl6h\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778439 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-sys\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-proc\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-podres\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778535    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-sys\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-lib-modules\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778647 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778616    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-proc\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778831 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778647    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-lib-modules\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.778831 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.778668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99f86832-f1fd-4e9b-ab7e-61e1982c3001-podres\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.789015 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.788991    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwl6h\" (UniqueName: \"kubernetes.io/projected/99f86832-f1fd-4e9b-ab7e-61e1982c3001-kube-api-access-nwl6h\") pod \"perf-node-gather-daemonset-mph5z\" (UID: \"99f86832-f1fd-4e9b-ab7e-61e1982c3001\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:00.865879 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:00.865797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:01.000845 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:01.000810    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"]
Jul 07 16:12:01.003634 ip-10-0-132-109 kubenswrapper[2573]: W0707 16:12:01.003605    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99f86832_f1fd_4e9b_ab7e_61e1982c3001.slice/crio-815ce62d352e6aee890fe49615c0cc9a5854232a5b6e1a3ee2db8075f93fba89 WatchSource:0}: Error finding container 815ce62d352e6aee890fe49615c0cc9a5854232a5b6e1a3ee2db8075f93fba89: Status 404 returned error can't find the container with id 815ce62d352e6aee890fe49615c0cc9a5854232a5b6e1a3ee2db8075f93fba89
Jul 07 16:12:01.349592 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:01.349558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z" event={"ID":"99f86832-f1fd-4e9b-ab7e-61e1982c3001","Type":"ContainerStarted","Data":"4e3fe2e562194807eaf5431cf192f2af4ca1ef0bfee5d3a38481144140abfaf3"}
Jul 07 16:12:01.349788 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:01.349610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z" event={"ID":"99f86832-f1fd-4e9b-ab7e-61e1982c3001","Type":"ContainerStarted","Data":"815ce62d352e6aee890fe49615c0cc9a5854232a5b6e1a3ee2db8075f93fba89"}
Jul 07 16:12:01.349788 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:01.349661    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:01.366467 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:01.366426    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z" podStartSLOduration=1.366412905 podStartE2EDuration="1.366412905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:12:01.364828677 +0000 UTC m=+2517.389025947" watchObservedRunningTime="2026-07-07 16:12:01.366412905 +0000 UTC m=+2517.390610175"
Jul 07 16:12:04.086005 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:04.085968    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd5qn_41c75795-2322-445f-9d4f-6b824fffd84a/dns/0.log"
Jul 07 16:12:04.108316 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:04.108285    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd5qn_41c75795-2322-445f-9d4f-6b824fffd84a/kube-rbac-proxy/0.log"
Jul 07 16:12:04.295163 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:04.295138    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xt7lq_d35102d5-b6ee-403d-9412-2b0a9b317468/dns-node-resolver/0.log"
Jul 07 16:12:04.980797 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:04.980763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8vpk_65803f05-64dc-47f2-a0f5-1087a948de3a/node-ca/0.log"
Jul 07 16:12:06.000108 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:06.000078    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hl5rd_c18eae91-3bb2-498e-97a4-7337ae5a6012/istio-proxy/0.log"
Jul 07 16:12:06.302881 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:06.302788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/0.log"
Jul 07 16:12:06.360813 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:06.360777    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/1.log"
Jul 07 16:12:06.411314 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:06.411282    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2vdph_f30ae3ef-146b-4b6c-be65-4469c383cc75/payload-pre-processing/0.log"
Jul 07 16:12:07.209094 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:07.209049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fjlr2_7c4202c0-44f7-4c01-be06-c624e8b2ad06/serve-healthcheck-canary/0.log"
Jul 07 16:12:07.364541 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:07.364511    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-mph5z"
Jul 07 16:12:07.899432 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:07.899399    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2q77_7d086fd7-1764-4a45-ad07-9d142c5ea357/kube-rbac-proxy/0.log"
Jul 07 16:12:07.924942 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:07.924914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2q77_7d086fd7-1764-4a45-ad07-9d142c5ea357/exporter/0.log"
Jul 07 16:12:07.948833 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:07.948808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2q77_7d086fd7-1764-4a45-ad07-9d142c5ea357/extractor/0.log"
Jul 07 16:12:10.501042 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:10.501008    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zxrxw_3665dfd5-7a1f-43b3-a395-db380544ecb4/manager/0.log"
Jul 07 16:12:10.748588 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:10.748532    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6j5bm_676cf42b-ee17-402f-a7a0-5472686f2f55/manager/0.log"
Jul 07 16:12:10.832465 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:10.832373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723985-mp4lp_fdb6b012-fecc-40a1-909a-88cccb7981ad/cleanup/0.log"
Jul 07 16:12:10.867911 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:10.867886    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724000-fhmwd_603475ac-5924-4c28-b0f7-367c6a5664bc/cleanup/0.log"
Jul 07 16:12:11.046483 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.046445    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f76876c5d-82g62_7423520e-8be9-4909-bd7f-a1e94e0666cd/manager/0.log"
Jul 07 16:12:11.342461 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.342431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-ml5r5_e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed/manager/0.log"
Jul 07 16:12:11.363806 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.363775    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-ml5r5_e5f2495d-9fd4-44a3-8ab9-2d2de0e7c9ed/copy-manifests/0.log"
Jul 07 16:12:11.539239 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.539204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hl5rd_c18eae91-3bb2-498e-97a4-7337ae5a6012/istio-proxy/0.log"
Jul 07 16:12:11.845840 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.845799    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/0.log"
Jul 07 16:12:11.904612 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.904564    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/1.log"
Jul 07 16:12:11.965087 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:11.965045    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2vdph_f30ae3ef-146b-4b6c-be65-4469c383cc75/payload-pre-processing/0.log"
Jul 07 16:12:12.975763 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:12.975680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb8c6bffd-vqwxr_63fe93e3-e9e9-4468-9dde-cb21cb7860cd/manager/0.log"
Jul 07 16:12:13.268090 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:13.268036    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hl5rd_c18eae91-3bb2-498e-97a4-7337ae5a6012/istio-proxy/0.log"
Jul 07 16:12:13.563915 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:13.563830    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/0.log"
Jul 07 16:12:13.618685 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:13.618655    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zhqtg_bd94016d-1de2-4a70-ba03-ae649c278c56/istio-proxy/1.log"
Jul 07 16:12:13.675137 ip-10-0-132-109 kubenswrapper[2573]: I0707 16:12:13.675099    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2vdph_f30ae3ef-146b-4b6c-be65-4469c383cc75/payload-pre-processing/0.log"